Apr 10 18:20:14 devstack cinder-volume[72278]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 18:20:14 devstack cinder-volume[72278]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 18:20:14 devstack cinder-volume[72278]: we strongly recommend against using it for new projects. Apr 10 18:20:14 devstack cinder-volume[72278]: If you are already using Eventlet, we recommend migrating to a different Apr 10 18:20:14 devstack cinder-volume[72278]: framework. For more detail see Apr 10 18:20:14 devstack cinder-volume[72278]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 18:20:14 devstack cinder-volume[72278]: import eventlet # noqa Apr 10 18:20:16 devstack cinder-volume[72278]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:20:16 devstack cinder-volume[72278]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:20:16 devstack cinder-volume[72278]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:20:16 devstack cinder-volume[72278]: INFO dbcounter [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Registered counter for database cinder Apr 10 18:20:16 devstack cinder-volume[72278]: DEBUG oslo_db.sqlalchemy.engines [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:20:16 devstack cinder-volume[72278]: DEBUG dbcounter [-] [72278] Writer thread running {{(pid=72278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 18:20:16 devstack cinder-volume[72278]: INFO cinder.rpc [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 18:20:16 devstack cinder-volume[72278]: INFO cinder.rpc [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_db.sqlalchemy.engines [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:20:17 devstack cinder-volume[72278]: INFO cinder.volume.manager [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Determined volume DB was empty at startup. Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG cinder.volume.manager [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72278) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 18:20:17 devstack cinder-volume[72278]: INFO cinder.volume.manager [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 18:20:17 devstack cinder-volume[72278]: WARNING stevedore.named [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 18:20:17 devstack cinder-volume[72278]: WARNING castellan.key_manager [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:20:17 devstack cinder-volume[72278]: WARNING cinder.keymgr.conf_key_mgr [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG cinder.volume.drivers.lvm [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72278) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_concurrency.processutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_concurrency.processutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] CMD "cinder-rtstool verify" returned: 0 in 0.260s {{(pid=72278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_db.sqlalchemy.engines [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:20:17 devstack cinder-volume[72278]: INFO cinder.rpc [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 18:20:17 devstack cinder-volume[72278]: INFO cinder.rpc [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 18:20:17 devstack cinder-volume[72278]: WARNING stevedore.named [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 18:20:17 devstack cinder-volume[72278]: WARNING castellan.key_manager [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:20:17 devstack cinder-volume[72278]: INFO cinder.volume.manager [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_db.sqlalchemy.engines [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72278) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:20:17 devstack cinder-volume[72278]: INFO oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Starting 1 workers Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Started child 72385 {{(pid=72278) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Full set of CONF: {{(pid=72278) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] ******************************************************************************** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Configuration options gathered from: {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] ================================================================================ {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 18:20:17 devstack cinder-volume[72385]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] allow_availability_zone_fallback = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] allow_compression_on_image_upload = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] allowed_direct_url_schemes = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] api_rate_limit = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] auth_strategy = keystone {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] az_cache_duration = 3600 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_availability_zone = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_host = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_stats_polling_interval = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backup_api_class = cinder.backup.api.API {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backup_name_template = backup-%s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backup_use_same_host = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backup_use_temp_snapshot = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] chap_password = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] chap_username = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_internal_tenant_project_id = e8044a3e1a5f4fdf9ee242edc73099eb {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_internal_tenant_user_id = e46dcc2c54e64a5d88ae6d1105c36b9d {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cloned_volume_same_az = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cluster = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] compression_format = gzip {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] compute_api_class = cinder.compute.nova.API {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] config_dir = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] config_source = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] control_exchange = openstack {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] debug = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] default_availability_zone = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] default_group_type = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] default_volume_type = lvmdriver-1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] disk_geometry = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] driver_client_cert = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] driver_client_cert_key = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] driver_data_namespace = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] driver_ssl_cert_path = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] driver_ssl_cert_verify = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] driver_use_ssl = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] enable_force_upload = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] enable_new_services = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] enable_unsupported_driver = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] enabled_backends = ['lvmdriver-1'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] enforce_multipath_for_image_xfer = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] filter_function = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_api_insecure = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_api_ssl_compression = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_ca_certificates_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_catalog_info = image:glance:publicURL {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_num_retries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance_request_timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] goodness_function = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] graceful_shutdown_timeout = 5 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] group_api_class = cinder.group.api.API {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] host = devstack {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_compress_on_upload = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_conversion_address_space_limit = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_conversion_cpu_limit = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_conversion_disable = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_upload_use_cinder_backend = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_upload_use_internal_tenant = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_volume_cache_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_volume_cache_max_count = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] image_volume_cache_max_size_gb = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] init_host_max_objects_retrieval = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] instance_format = [instance: %(uuid)s] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] iscsi_target_flags = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] iscsi_write_cache = on {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] iser_helper = tgtadm {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72385]: INFO cinder.volume.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] iser_ip_address = 192.168.122.98 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] iser_port = 3260 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_color = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_config_append = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_dir = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_options = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_rotate_interval = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_rotate_interval_type = days {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] log_rotation_type = none {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] max_age = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] max_logfile_count = 30 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] max_logfile_size_mb = 200 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] max_over_subscription_ratio = 20.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] message_reap_interval = 86400 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] message_ttl = 2592000 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] migration_create_volume_timeout_secs = 300 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] monkey_patch = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] monkey_patch_modules = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] my_ip = 192.168.122.98 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] no_snapshot_gb_quota = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] num_iser_scan_tries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] num_shell_tries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] num_volume_device_scan_tries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] nvmeof_conn_info_version = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] nvmet_ns_id = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] nvmet_port_id = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_max_limit = 1000 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_volume_ext_list = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_volume_listen = 0.0.0.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_volume_listen_port = 8776 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_volume_use_ssl = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] osapi_volume_workers = 2 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] per_volume_size_limit = -1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] periodic_fuzzy_delay = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] periodic_interval = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] project_id_regex = [0-9a-f\-]+ {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] public_endpoint = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] publish_errors = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_backup_gigabytes = 1000 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_backups = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_gigabytes = 1000 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_groups = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_snapshots = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] quota_volumes = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] rate_limit_burst = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] rate_limit_except_level = CRITICAL {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] rate_limit_interval = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] reinit_driver_count = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] replication_device = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] report_discard_supported = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] report_interval = 120 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] reservation_clean_interval = 86400 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] reservation_expire = 86400 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] reserved_image_namespaces = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] reserved_percentage = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] rpc_response_timeout = 120 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] run_external_periodic_tasks = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] scst_target_driver = iscsi {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] scst_target_iqn_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_down_time = 720 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] shell_completion = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] snapshot_name_template = snapshot-%s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] snapshot_same_host = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] split_loggers = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] state_path = /opt/stack/data/cinder {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] storage_availability_zone = nova {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] storage_protocol = iSCSI {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] syslog_log_facility = LOG_USER {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] target_helper = lioadm {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] target_ip_address = 192.168.122.98 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] target_port = 3260 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] target_protocol = iscsi {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] target_secondary_ip_addresses = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] trace_flags = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] transfer_api_class = cinder.transfer.api.API {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] transport_url = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] until_refresh = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_chap_auth = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_default_quota_class = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_journal = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_json = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_multipath_for_image_xfer = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_stderr = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] use_syslog = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] verify_glance_signatures = enabled {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_api_class = cinder.volume.api.API {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_backend_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_clear = zero {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_clear_ionice = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_clear_size = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_copy_bps_limit = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_dd_blocksize = 1M {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_name_template = volume-%s {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_service_inithost_offload = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volume_usage_audit_period = month {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] zoning_mode = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_concurrency.disable_process_locking = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.admin_password = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.admin_token = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.admin_user = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_admin_prefix = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_port = 35357 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_protocol = https {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_section = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_type = password {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_uri = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.auth_version = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.cache = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.delay_auth_decision = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.http_connect_timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.identity_uri = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.include_service_catalog = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.insecure = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.interface = public {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_password = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcache_username = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.region_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.service_token_roles_required = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.service_type = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.token_cache_time = 300 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.backend = dogpile.cache.null {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.backend_argument = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.backend_expiration_time = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.config_prefix = cache.oslo {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.debug_cache_backend = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.enable_retry_client = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.enable_socket_keepalive = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.enforce_fips_mode = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.expiration_time = 600 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.hashclient_retry_attempts = 2 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_dead_retry = 300 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_pool_maxsize = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_sasl_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.password = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.proxies = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.redis_db = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.redis_sentinel_service_name = mymaster {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.redis_server = localhost:6379 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.retry_attempts = 2 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.retry_delay = 0.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.socket_keepalive_count = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.socket_keepalive_idle = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.socket_keepalive_interval = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.socket_timeout = 1.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.tls_allowed_ciphers = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.tls_cafile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.tls_certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.tls_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.tls_keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cache.username = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] coordination.backend_url = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.asyncio_connection = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.asyncio_slave_connection = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.backend = sqlalchemy {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.connection = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.connection_debug = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.connection_parameters = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.connection_recycle_time = 3600 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.connection_trace = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.db_inc_retry_interval = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.db_max_retries = 20 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.db_max_retry_interval = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.db_retry_interval = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.max_overflow = 50 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.max_pool_size = 5 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.max_retries = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.mysql_wsrep_sync_wait = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.pool_timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.retry_interval = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.slave_connection = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.sqlite_synchronous = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.synchronous_reader = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] database.use_db_reconnect = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.connection_string = messaging:// {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.es_doc_type = notification {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.es_scroll_size = 10000 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.es_scroll_time = 2m {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.filter_error_trace = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.hmac_keys = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.sentinel_service_name = mymaster {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.socket_timeout = 0.1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.trace_requests = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler.trace_sqlalchemy = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler_jaeger.process_tags = {} {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler_jaeger.service_name_prefix = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] profiler_otlp.service_name_prefix = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.enforce_new_defaults = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: WARNING oslo_config.cfg [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.enforce_scope = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.policy_default_rule = default {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.policy_file = policy.yaml {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_policy.remote_timeout = 60.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.group = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.helper_command = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] privsep_osbrick.user = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.group = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.helper_command = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] cinder_sys_admin.user = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.auth_section = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.auth_type = password {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.cafile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.collect_timing = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.insecure = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.send_service_user_token = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.split_loggers = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] service_user.timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.auth_section = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.auth_type = password {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.collect_timing = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.insecure = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.region_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.split_loggers = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] glance.timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.backend_availability_zone = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.chap_password = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.chap_username = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.disk_geometry = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.driver_client_cert = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.driver_client_cert_key = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.driver_data_namespace = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.driver_use_ssl = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.enable_unsupported_driver = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.extra_capabilities = {} {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.filter_function = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.goodness_function = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.iscsi_target_flags = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.iscsi_write_cache = on {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.iser_helper = tgtadm {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.iser_port = 3260 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.lvm_mirrors = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.lvm_share_target = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.lvm_type = auto {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.num_shell_tries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.nvmet_port_id = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.replication_device = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.report_discard_supported = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.reserved_percentage = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.scst_target_driver = iscsi {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.scst_target_iqn_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.storage_protocol = iSCSI {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.target_helper = tgtadm {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.target_port = 3260 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.target_protocol = iscsi {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.trace_flags = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.unique_fqdn_network = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.use_chap_auth = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_backend_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_clear = zero {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_clear_ionice = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_clear_size = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack sudo[72389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volume_group = cinder-volumes {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_reports.file_event_handler = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_reports.log_dir = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.backend_availability_zone = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack sudo[72389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.backend_host = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.chap_password = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.chap_username = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.chiscsi_conf = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.disk_geometry = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.driver_client_cert = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.driver_data_namespace = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.driver_use_ssl = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.extra_capabilities = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.filter_function = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.goodness_function = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.iser_helper = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.iser_ip_address = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.iser_port = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.iser_target_prefix = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.lvm_conf_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.lvm_mirrors = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.lvm_share_target = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.lvm_type = auto {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.num_shell_tries = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.nvmet_port_id = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.replication_device = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.report_discard_supported = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.reserved_percentage = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.scst_target_driver = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.storage_protocol = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.target_helper = lioadm {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.target_ip_address = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.target_port = 3260 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.target_protocol = iscsi {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.trace_flags = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.use_chap_auth = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_clear = zero {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_clear_size = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] lvmdriver-1.volumes_dir = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.ssl = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.ssl_version = {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_notifications.driver = [] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_notifications.retry = -1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] oslo_messaging_notifications.transport_url = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] key_manager.fixed_key = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.barbican_api_version = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.barbican_endpoint = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.barbican_endpoint_type = public {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.barbican_region_name = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.cafile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.collect_timing = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.insecure = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.number_of_retries = 60 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.retry_delay = 1 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.send_service_user_token = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.split_loggers = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.verify_ssl = True {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican.verify_ssl_path = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.auth_section = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.auth_type = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.cafile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.certfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.collect_timing = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.insecure = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.keyfile = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.split_loggers = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] barbican_service_user.timeout = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.approle_role_id = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.approle_secret_id = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.kv_mountpoint = secret {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.kv_path = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.kv_version = 2 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.namespace = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.root_token_id = **** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.ssl_ca_crt_file = None {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.timeout = 60.0 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.use_ssl = False {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:20:17 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] ******************************************************************************** {{(pid=72278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 18:20:18 devstack sudo[72389]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.583s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:18 devstack sudo[72545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:18 devstack sudo[72545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:18 devstack sudo[72545]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.542s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:20:18 devstack cinder-volume[72385]: INFO cinder.brick.local_dev.lvm [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:18 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:18 devstack sudo[72767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:20:18 devstack sudo[72767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:19 devstack sudo[72767]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:19 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.520s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:19 devstack cinder-volume[72385]: DEBUG cinder.brick.local_dev.lvm [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72385) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 18:20:19 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:19 devstack sudo[72912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:19 devstack sudo[72912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:20 devstack sudo[72912]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.831s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:20 devstack sudo[73048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:20 devstack sudo[73048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:20 devstack sudo[73048]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:20 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:20 devstack sudo[73080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 18:20:20 devstack sudo[73080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:21 devstack sudo[73080]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:21 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.421s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:21 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:21 devstack sudo[73083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:20:21 devstack sudo[73083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:21 devstack sudo[73083]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:21 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:21 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:21 devstack sudo[73089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:20:21 devstack sudo[73089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:21 devstack sudo[73089]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:21 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:21 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:21 devstack sudo[73095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:21 devstack sudo[73095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:22 devstack sudo[73095]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:22 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:22 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:22 devstack sudo[73100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:22 devstack sudo[73100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:22 devstack sudo[73100]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:22 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:22 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:22 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:22 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:22 devstack sudo[73104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:22 devstack sudo[73104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:23 devstack sudo[73104]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:23 devstack cinder-volume[72385]: INFO cinder.volume.drivers.lvm [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:23 devstack sudo[73112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:23 devstack sudo[73112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:23 devstack sudo[73112]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG cinder.volume.drivers.lvm [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Updating volume stats {{(pid=72385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 18:20:23 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:23 devstack sudo[73228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:20:23 devstack sudo[73228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:24 devstack sudo[73228]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:24 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:24 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:24 devstack sudo[73232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:24 devstack sudo[73232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:24 devstack sudo[73232]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:24 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:24 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:24 devstack sudo[73370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:24 devstack sudo[73370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:25 devstack sudo[73370]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:25 devstack sudo[73375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:25 devstack sudo[73375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:25 devstack sudo[73375]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:25 devstack cinder-volume[72385]: INFO cinder.volume.driver [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG cinder.volume.driver [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72385) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG oslo_db.sqlalchemy.engines [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG dbcounter [-] [72385] Writer thread running {{(pid=72385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG cinder.db.sqlalchemy.api [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Building query based on filter {{(pid=72385) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG cinder.image.image_utils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72385) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 18:20:25 devstack cinder-volume[72385]: INFO cinder.keymgr.migration [None req-0bfa52a1-fc2c-4d8a-834a-d5a5b031336f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG cinder.volume.drivers.lvm [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Updating volume stats {{(pid=72385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 18:20:25 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:25 devstack sudo[73382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:20:25 devstack sudo[73382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:26 devstack sudo[73382]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:26 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:26 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:26 devstack sudo[73386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:26 devstack sudo[73386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:26 devstack sudo[73386]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:26 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:26 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:26 devstack sudo[73389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:26 devstack sudo[73389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:27 devstack sudo[73389]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:27 devstack sudo[73394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:27 devstack sudo[73394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:27 devstack cinder-volume[72278]: DEBUG dbcounter [-] [72278] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72278) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:20:27 devstack sudo[73394]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG cinder.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Notifying Schedulers of capabilities ... {{(pid=72385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:20:27 devstack cinder-volume[72385]: INFO cinder.volume.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Driver initialization completed successfully. Apr 10 18:20:27 devstack cinder-volume[72385]: INFO cinder.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Initiating service 2 cleanup Apr 10 18:20:27 devstack cinder-volume[72385]: INFO cinder.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Service 2 cleanup completed. Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG cinder.service [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Creating RPC server for service cinder-volume {{(pid=72385) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG cinder.service [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72385) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 18:20:27 devstack cinder-volume[72385]: INFO cinder.volume.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG cinder.volume.drivers.lvm [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Updating volume stats {{(pid=72385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 18:20:27 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:27 devstack sudo[73401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:20:27 devstack sudo[73401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:28 devstack sudo[73401]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:28 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.494s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:28 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:28 devstack sudo[73406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:28 devstack sudo[73406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:28 devstack sudo[73406]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:28 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:28 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:28 devstack sudo[73410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:20:28 devstack sudo[73410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:29 devstack sudo[73410]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:29 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:29 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:20:29 devstack sudo[73467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:20:29 devstack sudo[73467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:20:29 devstack sudo[73467]: pam_unix(sudo:session): session closed for user root Apr 10 18:20:29 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:20:29 devstack cinder-volume[72385]: INFO cinder.volume.manager [None req-dafaabd1-5502-4a3e-946a-e578a17b5e29 None None] Driver post RPC initialization completed successfully. Apr 10 18:20:39 devstack cinder-volume[72385]: DEBUG dbcounter [-] [72385] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:20:39 devstack cinder-volume[72385]: DEBUG dbcounter [-] [72385] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=72385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:22:01 devstack cinder-volume[72385]: DEBUG oslo_service.periodic_task [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:22:01 devstack cinder-volume[72385]: DEBUG cinder.volume.drivers.lvm [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Updating volume stats {{(pid=72385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 18:22:01 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:22:01 devstack sudo[78493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:22:01 devstack sudo[78493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:22:01 devstack sudo[78493]: pam_unix(sudo:session): session closed for user root Apr 10 18:22:01 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:22:01 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:22:01 devstack sudo[78496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:22:01 devstack sudo[78496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:22:02 devstack sudo[78496]: pam_unix(sudo:session): session closed for user root Apr 10 18:22:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:22:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:22:02 devstack sudo[78499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:22:02 devstack sudo[78499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:22:02 devstack sudo[78499]: pam_unix(sudo:session): session closed for user root Apr 10 18:22:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:22:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:22:02 devstack sudo[78502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:22:02 devstack sudo[78502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:22:03 devstack sudo[78502]: pam_unix(sudo:session): session closed for user root Apr 10 18:22:03 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:22:03 devstack cinder-volume[72385]: DEBUG cinder.manager [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Notifying Schedulers of capabilities ... {{(pid=72385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:22:39 devstack cinder-volume[72385]: DEBUG dbcounter [-] [72385] Writing DB stats cinder:SELECT=1 {{(pid=72385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:22:39 devstack cinder-volume[72385]: DEBUG dbcounter [-] [72385] Writing DB stats cinder:UPDATE=1 {{(pid=72385) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:23:01 devstack cinder-volume[72385]: DEBUG oslo_service.periodic_task [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72385) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:23:01 devstack cinder-volume[72385]: DEBUG cinder.volume.drivers.lvm [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Updating volume stats {{(pid=72385) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 18:23:01 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:01 devstack sudo[80454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 18:23:01 devstack sudo[80454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:01 devstack sudo[80454]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:01 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:01 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:01 devstack sudo[80465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:23:01 devstack sudo[80465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:02 devstack sudo[80465]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:02 devstack sudo[80468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 18:23:02 devstack sudo[80468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:02 devstack sudo[80468]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:02 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:02 devstack sudo[80472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 18:23:02 devstack sudo[80472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:03 devstack sudo[80472]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:03 devstack cinder-volume[72385]: DEBUG oslo_concurrency.processutils [None req-274647ad-9ab7-4363-9598-24d519502721 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72385) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:03 devstack cinder-volume[72385]: DEBUG cinder.manager [None req-274647ad-9ab7-4363-9598-24d519502721 None None] Notifying Schedulers of capabilities ... {{(pid=72385) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:23:46 devstack cinder-volume[72278]: INFO oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Caught SIGTERM, stopping children Apr 10 18:23:46 devstack cinder-volume[72278]: DEBUG oslo_concurrency.lockutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Acquiring lock "singleton_lock" {{(pid=72278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:23:46 devstack cinder-volume[72278]: DEBUG oslo_concurrency.lockutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Acquired lock "singleton_lock" {{(pid=72278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:23:46 devstack cinder-volume[72278]: DEBUG oslo_concurrency.lockutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Releasing lock "singleton_lock" {{(pid=72278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:23:46 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Stop services. {{(pid=72278) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 18:23:46 devstack cinder-volume[72278]: DEBUG oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Killing children. {{(pid=72278) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 18:23:46 devstack cinder-volume[72278]: INFO oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Waiting on 1 children to exit Apr 10 18:23:47 devstack cinder-volume[72385]: DEBUG oslo_concurrency.lockutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Acquiring lock "singleton_lock" {{(pid=72385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:23:47 devstack cinder-volume[72385]: DEBUG oslo_concurrency.lockutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Acquired lock "singleton_lock" {{(pid=72385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:23:47 devstack cinder-volume[72385]: DEBUG oslo_concurrency.lockutils [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Releasing lock "singleton_lock" {{(pid=72385) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:23:47 devstack cinder-volume[72385]: WARNING amqp [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 18:23:47 devstack cinder-volume[72385]: WARNING amqp [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 18:23:47 devstack cinder-volume[72278]: INFO oslo_service.backend._eventlet.service [None req-c1ec68d8-6c84-4c06-b923-769072480f5a None None] Child 72385 exited with status 0 Apr 10 18:23:47 devstack cinder-volume[81465]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 18:23:47 devstack cinder-volume[81465]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 18:23:47 devstack cinder-volume[81465]: we strongly recommend against using it for new projects. Apr 10 18:23:47 devstack cinder-volume[81465]: If you are already using Eventlet, we recommend migrating to a different Apr 10 18:23:47 devstack cinder-volume[81465]: framework. For more detail see Apr 10 18:23:47 devstack cinder-volume[81465]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 18:23:47 devstack cinder-volume[81465]: import eventlet # noqa Apr 10 18:23:49 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:23:49 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:23:49 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:23:50 devstack cinder-volume[81465]: INFO dbcounter [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Registered counter for database cinder Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG dbcounter [-] [81465] Writer thread running {{(pid=81465) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 18:23:50 devstack cinder-volume[81465]: INFO cinder.rpc [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 18:23:50 devstack cinder-volume[81465]: INFO cinder.rpc [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:23:50 devstack cinder-volume[81465]: INFO cinder.volume.manager [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Determined volume DB was empty at startup. Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG cinder.volume.manager [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81465) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 18:23:50 devstack cinder-volume[81465]: INFO cinder.volume.manager [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 18:23:50 devstack cinder-volume[81465]: WARNING stevedore.named [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 18:23:50 devstack cinder-volume[81465]: WARNING castellan.key_manager [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:23:50 devstack cinder-volume[81465]: WARNING cinder.keymgr.conf_key_mgr [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:23:50 devstack cinder-volume[81465]: INFO cinder.volume.manager [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_db.sqlalchemy.engines [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:23:50 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Starting 1 workers Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Started child 81584 {{(pid=81465) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Full set of CONF: {{(pid=81465) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] ******************************************************************************** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Configuration options gathered from: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] ================================================================================ {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] allow_availability_zone_fallback = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] allow_compression_on_image_upload = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] allowed_direct_url_schemes = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] api_rate_limit = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] auth_strategy = keystone {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_host = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_stats_polling_interval = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backup_api_class = cinder.backup.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backup_name_template = backup-%s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backup_use_same_host = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backup_use_temp_snapshot = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] chap_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] chap_username = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_internal_tenant_project_id = e8044a3e1a5f4fdf9ee242edc73099eb {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_internal_tenant_user_id = e46dcc2c54e64a5d88ae6d1105c36b9d {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cluster = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] compression_format = gzip {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] compute_api_class = cinder.compute.nova.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] config_dir = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] config_source = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] control_exchange = openstack {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] debug = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] default_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] default_group_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] default_volume_type = QuobyteHD {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] disk_geometry = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] driver_client_cert = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] driver_client_cert_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] driver_data_namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] driver_ssl_cert_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] driver_ssl_cert_verify = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] driver_use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] enable_new_services = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] enable_unsupported_driver = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] enabled_backends = ['QuobyteHD'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] enforce_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] filter_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_api_insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_api_ssl_compression = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_ca_certificates_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_catalog_info = image:glance:publicURL {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_num_retries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance_request_timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] goodness_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] graceful_shutdown_timeout = 5 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] group_api_class = cinder.group.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] host = devstack {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_compress_on_upload = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_conversion_address_space_limit = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_conversion_cpu_limit = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81584]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_conversion_disable = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_upload_use_cinder_backend = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_upload_use_internal_tenant = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_volume_cache_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_volume_cache_max_count = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] image_volume_cache_max_size_gb = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] init_host_max_objects_retrieval = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] instance_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] iscsi_target_flags = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] iscsi_write_cache = on {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] iser_helper = tgtadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] iser_ip_address = 192.168.122.98 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] iser_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_color = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_config_append = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_dir = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_options = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_rotate_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_rotate_interval_type = days {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] log_rotation_type = none {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] max_age = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] max_logfile_count = 30 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] max_logfile_size_mb = 200 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] max_over_subscription_ratio = 20.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] message_reap_interval = 86400 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] message_ttl = 2592000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] migration_create_volume_timeout_secs = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] monkey_patch = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] monkey_patch_modules = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] my_ip = 192.168.122.98 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] no_snapshot_gb_quota = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] num_iser_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] num_shell_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] num_volume_device_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] nvmeof_conn_info_version = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] nvmet_ns_id = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] nvmet_port_id = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_max_limit = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_volume_ext_list = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_volume_listen_port = 8776 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_volume_use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] osapi_volume_workers = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] per_volume_size_limit = -1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] periodic_fuzzy_delay = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] periodic_interval = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] public_endpoint = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] publish_errors = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_backup_gigabytes = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_backups = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_gigabytes = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_groups = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_snapshots = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] quota_volumes = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] rate_limit_burst = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] rate_limit_except_level = CRITICAL {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] rate_limit_interval = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] reinit_driver_count = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] replication_device = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] report_discard_supported = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] report_interval = 120 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] reservation_clean_interval = 86400 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] reservation_expire = 86400 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] reserved_image_namespaces = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] reserved_percentage = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] rpc_response_timeout = 120 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] run_external_periodic_tasks = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] scst_target_driver = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] scst_target_iqn_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_down_time = 720 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] shell_completion = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] snapshot_name_template = snapshot-%s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] state_path = /opt/stack/data/cinder {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] storage_availability_zone = nova {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] storage_protocol = iSCSI {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] syslog_log_facility = LOG_USER {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] target_helper = lioadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] target_ip_address = 192.168.122.98 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] target_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] target_protocol = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] target_secondary_ip_addresses = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] trace_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] transport_url = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] until_refresh = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_chap_auth = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_default_quota_class = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_journal = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_json = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_stderr = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] use_syslog = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] verify_glance_signatures = enabled {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_api_class = cinder.volume.api.API {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_backend_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_clear = zero {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_clear_ionice = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_clear_size = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_copy_bps_limit = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_dd_blocksize = 1M {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_name_template = volume-%s {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_service_inithost_offload = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.remotefs [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81584) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volume_usage_audit_period = month {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] zoning_mode = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_concurrency.disable_process_locking = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.admin_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.admin_token = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.admin_user = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_port = 35357 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_protocol = https {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_type = password {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_uri = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.auth_version = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.cache = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.identity_uri = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.include_service_catalog = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.interface = public {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_password = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcache_username = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.region_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.service_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.backend = dogpile.cache.null {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.backend_argument = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.backend_expiration_time = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.config_prefix = cache.oslo {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.debug_cache_backend = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.enable_retry_client = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.enable_socket_keepalive = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.enforce_fips_mode = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.expiration_time = 600 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.hashclient_retry_attempts = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_dead_retry = 300 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_pool_maxsize = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_sasl_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.proxies = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.redis_db = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.redis_server = localhost:6379 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.retry_attempts = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.retry_delay = 0.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.socket_keepalive_count = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.socket_keepalive_idle = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.socket_keepalive_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.socket_timeout = 1.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.tls_allowed_ciphers = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.tls_cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.tls_certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.tls_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.tls_keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cache.username = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] coordination.backend_url = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.asyncio_connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.asyncio_slave_connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.backend = sqlalchemy {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.connection_debug = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.connection_parameters = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.connection_recycle_time = 3600 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.connection_trace = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.db_inc_retry_interval = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.db_max_retries = 20 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.db_max_retry_interval = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.db_retry_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.max_overflow = 50 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.max_pool_size = 5 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.max_retries = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.mysql_wsrep_sync_wait = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.pool_timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.retry_interval = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.slave_connection = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.sqlite_synchronous = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.synchronous_reader = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] database.use_db_reconnect = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.connection_string = messaging:// {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.es_doc_type = notification {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.es_scroll_size = 10000 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.es_scroll_time = 2m {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.filter_error_trace = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.hmac_keys = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.sentinel_service_name = mymaster {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.socket_timeout = 0.1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.trace_requests = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler.trace_sqlalchemy = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler_jaeger.process_tags = {} {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler_jaeger.service_name_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] profiler_otlp.service_name_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.enforce_new_defaults = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: WARNING oslo_config.cfg [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.enforce_scope = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.policy_default_rule = default {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.policy_file = policy.yaml {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.group = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.helper_command = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81584) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 18:23:50 devstack cinder-volume[81584]: WARNING cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 18:23:50 devstack cinder-volume[81584]: WARNING cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] privsep_osbrick.user = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.group = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.helper_command = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Running cmd (subprocess): mount.quobyte {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] cinder_sys_admin.user = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.auth_type = password {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.send_service_user_token = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] service_user.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.auth_type = password {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.region_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] glance.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.backend_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.chap_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.chap_username = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.disk_geometry = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.driver_client_cert = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.driver_client_cert_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.driver_data_namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.driver_use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.extra_capabilities = {} {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.filter_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.goodness_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.iscsi_target_flags = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.iscsi_write_cache = on {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.iser_helper = tgtadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.iser_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_host = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_login = admin {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_mount_options = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_private_key = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_share_path = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.num_shell_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.quobyte_volume_url = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.replication_device = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.report_discard_supported = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.reserved_percentage = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.target_helper = tgtadm {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.target_port = 3260 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.target_protocol = iscsi {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.trace_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.unique_fqdn_network = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.use_chap_auth = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_backend_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_clear = zero {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_clear_ionice = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_clear_size = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_reports.file_event_handler = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_reports.log_dir = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.backend_availability_zone = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.backend_host = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.chap_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.chap_username = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.chiscsi_conf = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.disk_geometry = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.driver_client_cert = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.driver_data_namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.driver_use_ssl = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack quobyte-client[81585]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 18:23:50 devstack quobyte-client[81585]: Invalid parameters found, error: missing mount point. Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.extra_capabilities = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack quobyte-client[81585]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 18:23:50 devstack quobyte-client[81585]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.filter_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.goodness_function = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.iser_helper = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.iser_ip_address = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.iser_port = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.iser_target_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_host = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_login = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_mount_options = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_password = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_private_key = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_share_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_ssh_port = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.num_shell_tries = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.nvmet_port_id = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=81584) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: INFO cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 ... Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.replication_device = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 -c /etc/quobyte/client-cinder.cfg {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.report_discard_supported = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.reserved_percentage = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.scst_target_driver = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.storage_protocol = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.target_helper = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.target_ip_address = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.target_port = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.target_prefix = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.target_protocol = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.trace_flags = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.use_chap_auth = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_clear = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_clear_size = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] QuobyteHD.volumes_dir = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_notifications.driver = [] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_notifications.retry = -1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:50 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] key_manager.fixed_key = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.barbican_api_version = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.barbican_endpoint = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.barbican_endpoint_type = public {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.barbican_region_name = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.number_of_retries = 60 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.retry_delay = 1 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.send_service_user_token = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.verify_ssl = True {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican.verify_ssl_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.auth_section = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack sudo[81586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 -c /etc/quobyte/client-cinder.cfg Apr 10 18:23:51 devstack sudo[81586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.auth_type = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.cafile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.certfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.collect_timing = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.insecure = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.keyfile = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.split_loggers = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] barbican_service_user.timeout = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.approle_role_id = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.approle_secret_id = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.kv_mountpoint = secret {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.kv_path = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.kv_version = 2 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.namespace = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.root_token_id = **** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.ssl_ca_crt_file = None {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.timeout = 60.0 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.use_ssl = False {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:23:51 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] ******************************************************************************** {{(pid=81465) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 18:23:51 devstack sudo[81586]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:51 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.603s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:51 devstack cinder-volume[81584]: INFO cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 succeeded Apr 10 18:23:51 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=81584) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:23:51 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.628s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:23:51 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:51 devstack sudo[81672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:23:51 devstack sudo[81672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:52 devstack sudo[81672]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.661s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:52 devstack cinder-volume[81584]: INFO cinder.volume.driver [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Driver hasn't implemented _init_vendor_properties() Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.volume.driver [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81584) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_db.sqlalchemy.engines [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG dbcounter [-] [81584] Writer thread running {{(pid=81584) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.db.sqlalchemy.api [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Building query based on filter {{(pid=81584) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.image.image_utils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81584) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 18:23:52 devstack cinder-volume[81584]: INFO cinder.keymgr.migration [None req-417762a5-21c2-4721-b14e-0b72833b1c8e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=81584) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=81584) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:52 devstack sudo[81714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:23:52 devstack sudo[81714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:52 devstack sudo[81714]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.455s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:23:52 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Driver initialization completed successfully. Apr 10 18:23:52 devstack cinder-volume[81584]: INFO cinder.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Initiating service 3 cleanup Apr 10 18:23:52 devstack cinder-volume[81584]: INFO cinder.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Service 3 cleanup completed. Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.service [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Creating RPC server for service cinder-volume {{(pid=81584) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.service [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81584) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 18:23:52 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=81584) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=81584) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:23:52 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:52 devstack sudo[81723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:23:52 devstack sudo[81723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:53 devstack sudo[81723]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:53 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.391s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:53 devstack cinder-volume[81584]: INFO cinder.volume.manager [None req-c4225288-15f0-49cb-a561-673bbecc541e None None] Driver post RPC initialization completed successfully. Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=81584) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG cinder.volume.drivers.quobyte [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=81584) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81584) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:23:54 devstack sudo[81756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:23:54 devstack sudo[81756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:23:54 devstack sudo[81756]: pam_unix(sudo:session): session closed for user root Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG oslo_concurrency.processutils [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.392s {{(pid=81584) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:23:54 devstack cinder-volume[81584]: DEBUG cinder.manager [None req-43655b3e-db7b-40a8-9561-581f5ce2550f None None] Notifying Schedulers of capabilities ... {{(pid=81584) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:23:55 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Caught SIGTERM, stopping children Apr 10 18:23:55 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Acquiring lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:23:55 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Acquired lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:23:55 devstack cinder-volume[81465]: DEBUG oslo_concurrency.lockutils [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Releasing lock "singleton_lock" {{(pid=81465) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:23:55 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Stop services. {{(pid=81465) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 18:23:55 devstack cinder-volume[81465]: DEBUG oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Killing children. {{(pid=81465) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 18:23:55 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Waiting on 1 children to exit Apr 10 18:23:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Acquiring lock "singleton_lock" {{(pid=81584) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:23:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Acquired lock "singleton_lock" {{(pid=81584) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:23:57 devstack cinder-volume[81584]: DEBUG oslo_concurrency.lockutils [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Releasing lock "singleton_lock" {{(pid=81584) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:23:57 devstack cinder-volume[81584]: WARNING amqp [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 18:23:57 devstack cinder-volume[81584]: WARNING amqp [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 18:23:57 devstack cinder-volume[81465]: INFO oslo_service.backend._eventlet.service [None req-c47e63f4-04eb-4bb5-98b1-7fe1bd57f890 None None] Child 81584 exited with status 0 Apr 10 18:23:57 devstack cinder-volume[81810]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 18:23:57 devstack cinder-volume[81810]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 18:23:57 devstack cinder-volume[81810]: we strongly recommend against using it for new projects. Apr 10 18:23:57 devstack cinder-volume[81810]: If you are already using Eventlet, we recommend migrating to a different Apr 10 18:23:57 devstack cinder-volume[81810]: framework. For more detail see Apr 10 18:23:57 devstack cinder-volume[81810]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 18:23:57 devstack cinder-volume[81810]: import eventlet # noqa Apr 10 18:23:59 devstack cinder-volume[81810]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 18:23:59 devstack cinder-volume[81810]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 18:23:59 devstack cinder-volume[81810]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 18:23:59 devstack cinder-volume[81810]: INFO dbcounter [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Registered counter for database cinder Apr 10 18:23:59 devstack cinder-volume[81810]: DEBUG oslo_db.sqlalchemy.engines [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG dbcounter [-] [81810] Writer thread running {{(pid=81810) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 18:24:00 devstack cinder-volume[81810]: INFO cinder.rpc [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 18:24:00 devstack cinder-volume[81810]: INFO cinder.rpc [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_db.sqlalchemy.engines [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:24:00 devstack cinder-volume[81810]: INFO cinder.volume.manager [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Determined volume DB was empty at startup. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG cinder.volume.manager [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81810) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 18:24:00 devstack cinder-volume[81810]: WARNING stevedore.named [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 18:24:00 devstack cinder-volume[81810]: WARNING castellan.key_manager [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:24:00 devstack cinder-volume[81810]: WARNING cinder.keymgr.conf_key_mgr [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 18:24:00 devstack cinder-volume[81810]: INFO cinder.volume.manager [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_db.sqlalchemy.engines [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:24:00 devstack cinder-volume[81810]: INFO oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Starting 1 workers Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Started child 82020 {{(pid=81810) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Full set of CONF: {{(pid=81810) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] ******************************************************************************** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Configuration options gathered from: {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 18:24:00 devstack cinder-volume[82020]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] ================================================================================ {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] allow_availability_zone_fallback = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] allow_compression_on_image_upload = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] allowed_direct_url_schemes = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] api_rate_limit = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] auth_strategy = keystone {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_availability_zone = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_host = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_stats_polling_interval = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backup_api_class = cinder.backup.api.API {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backup_name_template = backup-%s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backup_use_same_host = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backup_use_temp_snapshot = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] chap_password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] chap_username = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_internal_tenant_project_id = e8044a3e1a5f4fdf9ee242edc73099eb {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_internal_tenant_user_id = e46dcc2c54e64a5d88ae6d1105c36b9d {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cluster = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] compression_format = gzip {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] compute_api_class = cinder.compute.nova.API {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] config_dir = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] config_source = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] control_exchange = openstack {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] debug = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] default_availability_zone = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] default_group_type = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] default_volume_type = QuobyteHD {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] disk_geometry = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] driver_client_cert = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] driver_client_cert_key = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] driver_data_namespace = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] driver_ssl_cert_path = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] driver_ssl_cert_verify = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] driver_use_ssl = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] enable_new_services = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] enable_unsupported_driver = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] enabled_backends = ['QuobyteHD'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] enforce_multipath_for_image_xfer = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] filter_function = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_api_insecure = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_api_servers = ['http://192.168.122.98/image'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_api_ssl_compression = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_ca_certificates_file = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_catalog_info = image:glance:publicURL {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_num_retries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance_request_timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] goodness_function = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] graceful_shutdown_timeout = 5 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] group_api_class = cinder.group.api.API {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] host = devstack {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_compress_on_upload = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82020) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_conversion_address_space_limit = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_conversion_cpu_limit = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_conversion_disable = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_upload_use_cinder_backend = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_upload_use_internal_tenant = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_volume_cache_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_volume_cache_max_count = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] image_volume_cache_max_size_gb = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] init_host_max_objects_retrieval = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] instance_format = [instance: %(uuid)s] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] iscsi_target_flags = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] iscsi_write_cache = on {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] iser_helper = tgtadm {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] iser_ip_address = 192.168.122.98 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] iser_port = 3260 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_color = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_config_append = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_dir = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_file = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_options = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_rotate_interval = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_rotate_interval_type = days {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] log_rotation_type = none {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] max_age = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] max_logfile_count = 30 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] max_logfile_size_mb = 200 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] max_over_subscription_ratio = 20.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] message_reap_interval = 86400 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] message_ttl = 2592000 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] migration_create_volume_timeout_secs = 300 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] monkey_patch = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] monkey_patch_modules = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] my_ip = 192.168.122.98 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] no_snapshot_gb_quota = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] num_iser_scan_tries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] num_shell_tries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] num_volume_device_scan_tries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] nvmeof_conn_info_version = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] nvmet_ns_id = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] nvmet_port_id = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_max_limit = 1000 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_volume_ext_list = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_volume_listen = 0.0.0.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_volume_listen_port = 8776 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_volume_use_ssl = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] osapi_volume_workers = 2 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] per_volume_size_limit = -1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] periodic_fuzzy_delay = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] periodic_interval = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] project_id_regex = [0-9a-f\-]+ {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] public_endpoint = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] publish_errors = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_backup_gigabytes = 1000 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_backups = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_gigabytes = 1000 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_groups = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_snapshots = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] quota_volumes = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] rate_limit_burst = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] rate_limit_except_level = CRITICAL {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] rate_limit_interval = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] reinit_driver_count = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] replication_device = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] report_discard_supported = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] report_interval = 120 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] reservation_clean_interval = 86400 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] reservation_expire = 86400 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] reserved_image_namespaces = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] reserved_percentage = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] rpc_response_timeout = 120 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] run_external_periodic_tasks = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] scst_target_driver = iscsi {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] scst_target_iqn_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_down_time = 720 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] shell_completion = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] snapshot_name_template = snapshot-%s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] split_loggers = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] state_path = /opt/stack/data/cinder {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] storage_availability_zone = nova {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] storage_protocol = iSCSI {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] syslog_log_facility = LOG_USER {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] target_helper = lioadm {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] target_ip_address = 192.168.122.98 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] target_port = 3260 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] target_protocol = iscsi {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] target_secondary_ip_addresses = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] trace_flags = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] transfer_api_class = cinder.transfer.api.API {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] transport_url = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] until_refresh = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_chap_auth = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_default_quota_class = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_journal = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_json = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_multipath_for_image_xfer = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_stderr = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] use_syslog = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] verify_glance_signatures = enabled {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_api_class = cinder.volume.api.API {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_backend_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_clear = zero {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_clear_ionice = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_clear_size = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_copy_bps_limit = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_dd_blocksize = 1M {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_name_template = volume-%s {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_service_inithost_offload = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volume_usage_audit_period = month {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] zoning_mode = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82020) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_concurrency.disable_process_locking = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.admin_password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Running cmd (subprocess): mount.quobyte {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.admin_token = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.admin_user = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_admin_prefix = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_port = 35357 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_protocol = https {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_section = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_type = password {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_uri = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.auth_version = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.cache = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.delay_auth_decision = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.http_connect_timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.identity_uri = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.include_service_catalog = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.insecure = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.interface = public {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_password = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcache_username = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.region_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.service_token_roles_required = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.service_type = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.token_cache_time = 300 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.98/identity {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.backend = dogpile.cache.null {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.backend_argument = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.backend_expiration_time = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.config_prefix = cache.oslo {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.debug_cache_backend = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.enable_retry_client = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.enable_socket_keepalive = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.enforce_fips_mode = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.expiration_time = 600 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.hashclient_retry_attempts = 2 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_dead_retry = 300 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_pool_maxsize = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_sasl_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.proxies = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.redis_db = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.redis_sentinel_service_name = mymaster {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.redis_server = localhost:6379 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.retry_attempts = 2 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.retry_delay = 0.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.socket_keepalive_count = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.socket_keepalive_idle = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.socket_keepalive_interval = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.socket_timeout = 1.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.tls_allowed_ciphers = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.tls_cafile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.tls_certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.tls_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.tls_keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cache.username = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] coordination.backend_url = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.asyncio_connection = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.asyncio_slave_connection = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.backend = sqlalchemy {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.connection = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.connection_debug = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.connection_parameters = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.connection_recycle_time = 3600 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.connection_trace = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.db_inc_retry_interval = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.db_max_retries = 20 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.db_max_retry_interval = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.db_retry_interval = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.max_overflow = 50 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.max_pool_size = 5 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.max_retries = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.mysql_wsrep_sync_wait = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.pool_timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.retry_interval = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.slave_connection = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.sqlite_synchronous = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.synchronous_reader = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] database.use_db_reconnect = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.connection_string = messaging:// {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.es_doc_type = notification {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.es_scroll_size = 10000 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.es_scroll_time = 2m {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.filter_error_trace = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.hmac_keys = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.sentinel_service_name = mymaster {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.socket_timeout = 0.1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.trace_requests = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler.trace_sqlalchemy = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler_jaeger.process_tags = {} {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler_jaeger.service_name_prefix = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] profiler_otlp.service_name_prefix = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.enforce_new_defaults = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: WARNING oslo_config.cfg [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.enforce_scope = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.policy_default_rule = default {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.policy_file = policy.yaml {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_policy.remote_timeout = 60.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.group = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.helper_command = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] privsep_osbrick.user = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.group = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.helper_command = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] cinder_sys_admin.user = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.auth_section = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.auth_type = password {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.cafile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.collect_timing = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.insecure = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.send_service_user_token = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.split_loggers = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] service_user.timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.auth_section = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.auth_type = password {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.collect_timing = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.insecure = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack quobyte-client[82032]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 18:24:00 devstack quobyte-client[82032]: Invalid parameters found, error: missing mount point. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.region_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.split_loggers = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack quobyte-client[82032]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 18:24:00 devstack quobyte-client[82032]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] glance.timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.backend_availability_zone = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.chap_password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.chap_username = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.disk_geometry = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.driver_client_cert = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.driver_client_cert_key = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.driver_data_namespace = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.driver_use_ssl = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.enable_unsupported_driver = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.extra_capabilities = {} {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.filter_function = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.goodness_function = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.iscsi_target_flags = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.iscsi_write_cache = on {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.iser_helper = tgtadm {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.iser_ip_address = 192.168.122.98 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.iser_port = 3260 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_host = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_login = admin {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_mount_options = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_private_key = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_share_path = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_ssh_port = 22 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.num_shell_tries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.nvmet_port_id = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_client_cfg = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.quobyte_volume_url = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.replication_device = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.report_discard_supported = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.reserved_percentage = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.scst_target_driver = iscsi {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.scst_target_iqn_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.storage_protocol = iSCSI {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.target_helper = tgtadm {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.target_ip_address = 192.168.122.98 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.target_port = 3260 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.target_protocol = iscsi {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.trace_flags = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.unique_fqdn_network = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.use_chap_auth = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_backend_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_clear = zero {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_clear_ionice = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_clear_size = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_reports.file_event_handler = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack sudo[82033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_reports.log_dir = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.backend_availability_zone = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack sudo[82033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.backend_host = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.chap_password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.chap_username = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.chiscsi_conf = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.disk_geometry = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.driver_client_cert = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.driver_client_cert_key = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.driver_data_namespace = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.driver_use_ssl = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.extra_capabilities = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.filter_function = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.goodness_function = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.iscsi_target_flags = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.iscsi_write_cache = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.iser_helper = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.iser_ip_address = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.iser_port = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.iser_target_prefix = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_host = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_login = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_mount_options = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_password = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_private_key = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_share_path = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_ssh_port = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.num_shell_tries = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nvmet_ns_id = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.nvmet_port_id = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.replication_device = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.report_discard_supported = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.reserved_percentage = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.scst_target_driver = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.storage_protocol = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.target_helper = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.target_ip_address = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.target_port = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.target_prefix = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.target_protocol = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.trace_flags = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.unique_fqdn_network = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.use_chap_auth = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_clear = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_clear_ionice = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_clear_size = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] QuobyteHD.volumes_dir = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.ssl = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.ssl_version = {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_notifications.driver = [] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_notifications.retry = -1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] oslo_messaging_notifications.transport_url = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] key_manager.fixed_key = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.barbican_api_version = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.barbican_endpoint = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.barbican_endpoint_type = public {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.barbican_region_name = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.cafile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.collect_timing = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.insecure = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.number_of_retries = 60 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.retry_delay = 1 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.send_service_user_token = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.split_loggers = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.verify_ssl = True {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican.verify_ssl_path = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.auth_section = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.auth_type = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.cafile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.certfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.collect_timing = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.insecure = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.keyfile = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.split_loggers = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] barbican_service_user.timeout = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.approle_role_id = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.approle_secret_id = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.kv_mountpoint = secret {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.kv_path = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.kv_version = 2 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.namespace = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.root_token_id = **** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.ssl_ca_crt_file = None {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.timeout = 60.0 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.use_ssl = False {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 18:24:00 devstack cinder-volume[81810]: DEBUG oslo_service.backend._eventlet.service [None req-93aa8419-a824-4bf7-b6f1-55fb4b3bc19c None None] ******************************************************************************** {{(pid=81810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 18:24:00 devstack sudo[82033]: pam_unix(sudo:session): session closed for user root Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.393s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:24:00 devstack cinder-volume[82020]: INFO cinder.volume.driver [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.driver [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82020) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_db.sqlalchemy.engines [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82020) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writer thread running {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.db.sqlalchemy.api [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Building query based on filter {{(pid=82020) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82020) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:24:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:24:00 devstack cinder-volume[82020]: INFO cinder.keymgr.migration [None req-e12914a9-8334-4f42-a5b6-163d7919e84b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 18:24:00 devstack sudo[82050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:24:00 devstack sudo[82050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:24:01 devstack sudo[82050]: pam_unix(sudo:session): session closed for user root Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.401s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:24:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Driver initialization completed successfully. Apr 10 18:24:01 devstack cinder-volume[82020]: INFO cinder.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Initiating service 3 cleanup Apr 10 18:24:01 devstack cinder-volume[82020]: INFO cinder.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Service 3 cleanup completed. Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG cinder.service [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Creating RPC server for service cinder-volume {{(pid=82020) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG cinder.service [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82020) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 18:24:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:24:01 devstack sudo[82055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:24:01 devstack sudo[82055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:24:01 devstack sudo[82055]: pam_unix(sudo:session): session closed for user root Apr 10 18:24:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.396s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:24:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-efaf5f58-3bf1-4d46-aae3-eb26710117f4 None None] Driver post RPC initialization completed successfully. Apr 10 18:24:10 devstack cinder-volume[81810]: DEBUG dbcounter [-] [81810] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81810) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:24:11 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:24:11 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=3 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Flow 'volume_create_manager' (5dcde50e-f2bc-4970-923e-7c06d697a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa31702e-f16c-41a5-a6a5-8229f9c73909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa31702e-f16c-41a5-a6a5-8229f9c73909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-247864242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87106b1d-61e8-4f1d-9568-1472a5d3c0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654428eade4144ac1cd27c481a6dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:02Z,use_quota=True,user_id='5e22b867e05341db9cf9e561da3f9f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1889b9-a9ef-4be6-b2c2-6de21f0ad5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1889b9-a9ef-4be6-b2c2-6de21f0ad5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d738cbe-928b-4b7a-96e5-ef3749d4d40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d738cbe-928b-4b7a-96e5-ef3749d4d40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87106b1d-61e8-4f1d-9568-1472a5d3c0e3', 'volume_name': 'volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6d2ce0-984b-462f-8316-d851b15e0d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6d2ce0-984b-462f-8316-d851b15e0d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13c607-ff08-44ca-943c-787c03123d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Volume 87106b1d-61e8-4f1d-9568-1472a5d3c0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3', 'volume_size': 1} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-247864242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87106b1d-61e8-4f1d-9568-1472a5d3c0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654428eade4144ac1cd27c481a6dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:02Z,use_quota=True,user_id='5e22b867e05341db9cf9e561da3f9f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Creating volume 87106b1d-61e8-4f1d-9568-1472a5d3c0e3 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:02 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:02 devstack sudo[82538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 1073741824 Apr 10 18:25:02 devstack sudo[82538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:03 devstack sudo[82538]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 1073741824" returned: 0 in 0.995s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:03 devstack sudo[82862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 Apr 10 18:25:03 devstack sudo[82862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:04 devstack sudo[82862]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3" returned: 0 in 0.977s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef13c607-ff08-44ca-943c-787c03123d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c40fce-6928-48aa-bccc-b63b58c5af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Volume volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 (87106b1d-61e8-4f1d-9568-1472a5d3c0e3): created successfully Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c40fce-6928-48aa-bccc-b63b58c5af52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Flow 'volume_create_manager' (5dcde50e-f2bc-4970-923e-7c06d697a708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2e9ef2f6-6036-4104-90eb-273beb07ec8b tempest-VolumeQuotasAdminTestJSON-942479159 None] Created volume successfully. Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Flow 'volume_create_manager' (ca1cee43-7bd4-4143-b8e3-754ef3927336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69b9e20-d209-425a-a534-c20e76fe5037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69b9e20-d209-425a-a534-c20e76fe5037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-36975236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b9c150-fb21-4599-be64-823425845b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e6e075542c4d809e545cd61c288099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:05Z,use_quota=True,user_id='3f6d6bb3575740b8a721d943c40c8e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961d61ef-0d5b-47e2-ad0c-48eb82c3b1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961d61ef-0d5b-47e2-ad0c-48eb82c3b1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca50a7e-2241-4371-a9ad-e7f920b497da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca50a7e-2241-4371-a9ad-e7f920b497da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b9c150-fb21-4599-be64-823425845b38', 'volume_name': 'volume-d4b9c150-fb21-4599-be64-823425845b38', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b532b638-a8e2-4aac-a1b0-9ac16c09ffa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b532b638-a8e2-4aac-a1b0-9ac16c09ffa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bda671-c9a9-41d8-a999-7c921238b7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Volume d4b9c150-fb21-4599-be64-823425845b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b9c150-fb21-4599-be64-823425845b38', 'volume_size': 1} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-36975236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b9c150-fb21-4599-be64-823425845b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74e6e075542c4d809e545cd61c288099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:05Z,use_quota=True,user_id='3f6d6bb3575740b8a721d943c40c8e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Creating volume d4b9c150-fb21-4599-be64-823425845b38 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:04 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:04 devstack sudo[83012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 1073741824 Apr 10 18:25:04 devstack sudo[83012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "cinder-87106b1d-61e8-4f1d-9568-1472a5d3c0e3-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "cinder-87106b1d-61e8-4f1d-9568-1472a5d3c0e3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "cinder-quobyte-87106b1d-61e8-4f1d-9568-1472a5d3c0e3" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "cinder-quobyte-87106b1d-61e8-4f1d-9568-1472a5d3c0e3" acquired by "delete_volume" :: waited 0.018s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:05 devstack cinder-volume[82020]: INFO oslo.privsep.daemon [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_fofe1mo/privsep.sock'] Apr 10 18:25:05 devstack sudo[83017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_fofe1mo/privsep.sock Apr 10 18:25:05 devstack sudo[83017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:06 devstack sudo[83012]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 1073741824" returned: 0 in 1.507s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:06 devstack sudo[83020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 Apr 10 18:25:06 devstack sudo[83020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Flow 'volume_create_manager' (acb7c9e2-12c9-4f8a-9d6f-eccab7e0842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64237587-c849-4fd2-8046-224433eaf5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64237587-c849-4fd2-8046-224433eaf5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-896753740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e03d44-c9b2-4bad-9de5-83b6cb2492bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86c18c927e4dd885008b65d0a8ac48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:06Z,use_quota=True,user_id='d1627bb40d83484692c21640d7b72da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553dd329-0150-4817-bce5-401caaefa4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553dd329-0150-4817-bce5-401caaefa4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b09439-0eac-4d04-a1eb-e982a24fdff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b09439-0eac-4d04-a1eb-e982a24fdff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e03d44-c9b2-4bad-9de5-83b6cb2492bd', 'volume_name': 'volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56a217d-1b83-4bc8-b599-92c319291a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56a217d-1b83-4bc8-b599-92c319291a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364ebd7a-d52c-45f6-a512-6ce5a67dccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:06 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Volume 38e03d44-c9b2-4bad-9de5-83b6cb2492bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd', 'volume_size': 1} Apr 10 18:25:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 18:25:06 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 18:25:07 devstack sudo[83020]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38" returned: 0 in 0.715s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.397s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-896753740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e03d44-c9b2-4bad-9de5-83b6cb2492bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86c18c927e4dd885008b65d0a8ac48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:06Z,use_quota=True,user_id='d1627bb40d83484692c21640d7b72da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Creating volume 38e03d44-c9b2-4bad-9de5-83b6cb2492bd {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:07 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bda671-c9a9-41d8-a999-7c921238b7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b9c150-fb21-4599-be64-823425845b38', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:07 devstack sudo[83026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd 1073741824 Apr 10 18:25:07 devstack sudo[83026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5904268d-3f0e-4a73-b2b6-a0094c0e204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:07 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Volume volume-d4b9c150-fb21-4599-be64-823425845b38 (d4b9c150-fb21-4599-be64-823425845b38): created successfully Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5904268d-3f0e-4a73-b2b6-a0094c0e204f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Flow 'volume_create_manager' (ca1cee43-7bd4-4143-b8e3-754ef3927336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1fb992bf-4911-4e8e-9871-60491c5ccea3 tempest-VolumesAdminNegativeTest-1213735190 None] Created volume successfully. Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 18:25:07 devstack cinder-volume[82020]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 18:25:07 devstack sudo[83017]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:07 devstack cinder-volume[82020]: INFO oslo.privsep.daemon [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Spawned new privsep daemon via rootwrap Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Accepted privsep connection to /tmp/tmp_fofe1mo/privsep.sock {{(pid=82020) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 18:25:07 devstack cinder-volume[82020]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 18:25:07 devstack cinder-volume[82020]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 18:25:07 devstack cinder-volume[82020]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 18:25:07 devstack cinder-volume[82020]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83028 Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[be187f43-e577-43e5-b83d-57ece866f649]: (2,) {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c245b78-79cd-410c-a151-6cb6247cd1c7]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:07 devstack sudo[83034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 Apr 10 18:25:07 devstack sudo[83034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:08 devstack sudo[83026]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd 1073741824" returned: 0 in 1.118s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:08 devstack sudo[83037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd Apr 10 18:25:08 devstack sudo[83037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:08 devstack sudo[83034]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3" returned: 0 in 0.831s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:08 devstack sudo[83042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3 Apr 10 18:25:08 devstack sudo[83042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Acquiring lock "cinder-d4b9c150-fb21-4599-be64-823425845b38-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "cinder-d4b9c150-fb21-4599-be64-823425845b38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Acquiring lock "cinder-quobyte-d4b9c150-fb21-4599-be64-823425845b38" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "cinder-quobyte-d4b9c150-fb21-4599-be64-823425845b38" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:09 devstack sudo[83037]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" returned: 0 in 0.883s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364ebd7a-d52c-45f6-a512-6ce5a67dccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b028fc-64c1-4600-b731-316d3b188a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6d1c8-8c54-47d3-9364-70392a1fb8b5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:09 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Volume volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd (38e03d44-c9b2-4bad-9de5-83b6cb2492bd): created successfully Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b028fc-64c1-4600-b731-316d3b188a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Flow 'volume_create_manager' (acb7c9e2-12c9-4f8a-9d6f-eccab7e0842e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:09 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-58b79c30-a6f9-4c67-9474-298b62058c0d tempest-DeleteServersTestJSON-1909674459 None] Created volume successfully. Apr 10 18:25:09 devstack sudo[83045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 Apr 10 18:25:09 devstack sudo[83045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:09 devstack sudo[83042]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-87106b1d-61e8-4f1d-9568-1472a5d3c0e3" returned: 0 in 0.938s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "cinder-quobyte-87106b1d-61e8-4f1d-9568-1472a5d3c0e3" released by "delete_volume" :: held 3.634s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:09 devstack cinder-volume[82020]: WARNING cinder.quota [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:25:09 devstack cinder-volume[82020]: WARNING cinder.quota [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Created reservations ['557474d1-90ef-42e0-85a4-c0516578ecd0', '5d8657ab-c0bf-4d81-815b-3c129f3a11f7', '36f3ea41-6862-4dc2-bcf9-0577c8b9bba9', 'b5552651-13ca-47c2-a924-dd80be3f0a63'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:09 devstack sudo[83048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:25:09 devstack sudo[83048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:10 devstack sudo[83045]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38" returned: 0 in 0.905s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:10 devstack sudo[83060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38 Apr 10 18:25:10 devstack sudo[83060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:10 devstack sudo[83048]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.208s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:10 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:25:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Deleted volume successfully. Apr 10 18:25:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fe125ed5-649b-46e6-b49f-8eb2ed28caf1 tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "cinder-87106b1d-61e8-4f1d-9568-1472a5d3c0e3-delete_volume" released by "delete_volume" :: held 5.229s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Flow 'volume_create_manager' (b60ef3f6-13cf-40af-a90a-3536e1ae20a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33b4870-6d6b-4591-8b34-b1a5aab719bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33b4870-6d6b-4591-8b34-b1a5aab719bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1321343641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5b5926-4a91-4bc1-9036-7757dc85be80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654428eade4144ac1cd27c481a6dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:11Z,use_quota=True,user_id='5e22b867e05341db9cf9e561da3f9f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0162468d-f057-4906-a16a-4289dd7427fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0162468d-f057-4906-a16a-4289dd7427fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:11 devstack sudo[83060]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7bb282-fe81-4350-bc12-eaf9c1b73c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7bb282-fe81-4350-bc12-eaf9c1b73c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5b5926-4a91-4bc1-9036-7757dc85be80', 'volume_name': 'volume-ab5b5926-4a91-4bc1-9036-7757dc85be80', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cc76ac-e109-4199-9662-78357e72fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cc76ac-e109-4199-9662-78357e72fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1293425f-65ff-409b-bd41-a3313b47299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:11 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Volume ab5b5926-4a91-4bc1-9036-7757dc85be80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5b5926-4a91-4bc1-9036-7757dc85be80', 'volume_size': 1} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1321343641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5b5926-4a91-4bc1-9036-7757dc85be80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654428eade4144ac1cd27c481a6dcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:11Z,use_quota=True,user_id='5e22b867e05341db9cf9e561da3f9f41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Creating volume ab5b5926-4a91-4bc1-9036-7757dc85be80 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:11 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d4b9c150-fb21-4599-be64-823425845b38" returned: 0 in 1.065s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "cinder-quobyte-d4b9c150-fb21-4599-be64-823425845b38" released by "delete_volume" :: held 2.046s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:11 devstack sudo[83176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 1073741824 Apr 10 18:25:11 devstack sudo[83176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Created reservations ['a55307e5-2d4b-4233-ae6e-64e5452d6099', '3cea3838-86d2-4dfd-a63c-54af25573fa9', 'f6b9f2a9-901a-40d9-bb8d-d172e88f7df3', '641f9b31-c24e-4c16-8bb8-7bcc915725ee'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:11 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:25:11 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:11 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.723s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:11 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:25:11 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Deleted volume successfully. Apr 10 18:25:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-56ebf24b-6b22-4a54-a51f-ac095fa39986 tempest-VolumesAdminNegativeTest-1213735190 None] Lock "cinder-d4b9c150-fb21-4599-be64-823425845b38-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:12 devstack sudo[83176]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 1073741824" returned: 0 in 1.136s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:12 devstack sudo[83187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 Apr 10 18:25:12 devstack sudo[83187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:13 devstack sudo[83187]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80" returned: 0 in 0.923s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1293425f-65ff-409b-bd41-a3313b47299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5b5926-4a91-4bc1-9036-7757dc85be80', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a78cf50-ee93-4a86-b659-af2cf9a7e816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:13 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Volume volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 (ab5b5926-4a91-4bc1-9036-7757dc85be80): created successfully Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a78cf50-ee93-4a86-b659-af2cf9a7e816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Flow 'volume_create_manager' (b60ef3f6-13cf-40af-a90a-3536e1ae20a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:13 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-97595aed-3cca-44d3-88e1-0ae4a3656dfd tempest-VolumeQuotasAdminTestJSON-942479159 None] Created volume successfully. Apr 10 18:25:15 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b6580c91-bd66-4228-8e1e-c1a023044298 tempest-VolumeQuotasAdminTestJSON-340519696 None] Transfer volume completed successfully. Apr 10 18:25:15 devstack cinder-volume[82020]: WARNING py.warnings [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 10 18:25:15 devstack cinder-volume[82020]: .first() Apr 10 18:25:15 devstack cinder-volume[82020]: Apr 10 18:25:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58ea575-a7a9-4427-a88f-d03a4626701d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:15 devstack sudo[83242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd Apr 10 18:25:16 devstack sudo[83242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Acquiring lock "cinder-ab5b5926-4a91-4bc1-9036-7757dc85be80-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Lock "cinder-ab5b5926-4a91-4bc1-9036-7757dc85be80-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Acquiring lock "cinder-quobyte-ab5b5926-4a91-4bc1-9036-7757dc85be80" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Lock "cinder-quobyte-ab5b5926-4a91-4bc1-9036-7757dc85be80" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf0f32-7d7b-4473-9981-c955165921a2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:16 devstack sudo[83242]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" returned: 0 in 0.866s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:16 devstack sudo[83248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:25:16 devstack sudo[83248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:16 devstack sudo[83247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 Apr 10 18:25:16 devstack sudo[83247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514', 'name': 'volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8fa546d-b244-4651-bd8e-6d292d1d9606', 'enforce_multipath': True} {{(pid=82020) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 18:25:16 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-edbbefd2-596c-4f15-a988-d46306cc0273 req-96486ebc-13ef-41ab-ac66-105694822388 tempest-DeleteServersTestJSON-1909674459 None] attachment_update completed successfully. Apr 10 18:25:17 devstack sudo[83248]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.860s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:25:17 devstack sudo[83247]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80" returned: 0 in 1.039s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:17 devstack sudo[83261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80 Apr 10 18:25:17 devstack sudo[83261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:18 devstack sudo[83261]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab5b5926-4a91-4bc1-9036-7757dc85be80" returned: 0 in 0.589s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Lock "cinder-quobyte-ab5b5926-4a91-4bc1-9036-7757dc85be80" released by "delete_volume" :: held 1.661s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Created reservations ['a378b923-c303-402b-8c16-3a3dd50639cd', '89fb385b-270f-47e6-ad32-4384696848f4', '7e33b59a-0b84-4348-9837-4991889e7ecd', 'eb122397-0ba0-4008-9326-319ee08d038c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:18 devstack sudo[83333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:25:18 devstack sudo[83333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:18 devstack sudo[83333]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.490s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:25:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Deleted volume successfully. Apr 10 18:25:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78513209-3405-4f89-a789-a0691a3f4145 tempest-VolumeQuotasAdminTestJSON-1040206815 None] Lock "cinder-ab5b5926-4a91-4bc1-9036-7757dc85be80-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Flow 'volume_create_manager' (3cb188c1-2320-4214-8c65-03c78dcf5a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f86376-c526-48ca-8fc8-36439ac1442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f86376-c526-48ca-8fc8-36439ac1442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:24Z,deleted=False,deleted_at=None,display_description='',display_name='d75f1a5f-a28b-450b-9170-431b01b53115-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682d32a0-5a7d-4102-85f8-1502b5782269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b4be2913fb44b19590ab44546a925a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:24Z,use_quota=True,user_id='cefb4217ea3c4d54b515cfc0b44ebf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b60f17-0ea2-4b52-8fe5-08cf3c3f8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b60f17-0ea2-4b52-8fe5-08cf3c3f8150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73fd29c-11bb-4b8e-ac95-4af44e0e30f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73fd29c-11bb-4b8e-ac95-4af44e0e30f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682d32a0-5a7d-4102-85f8-1502b5782269', 'volume_name': 'volume-682d32a0-5a7d-4102-85f8-1502b5782269', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5962e86-530f-4ff5-9355-6672e468bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5962e86-530f-4ff5-9355-6672e468bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3600a463-8cf2-4227-bcc3-7772cfb4e45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Volume 682d32a0-5a7d-4102-85f8-1502b5782269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682d32a0-5a7d-4102-85f8-1502b5782269', 'volume_size': 1} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:24Z,deleted=False,deleted_at=None,display_description='',display_name='d75f1a5f-a28b-450b-9170-431b01b53115-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682d32a0-5a7d-4102-85f8-1502b5782269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b4be2913fb44b19590ab44546a925a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:24Z,use_quota=True,user_id='cefb4217ea3c4d54b515cfc0b44ebf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Creating volume 682d32a0-5a7d-4102-85f8-1502b5782269 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:24 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:24 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 1073741824 Apr 10 18:25:24 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:25 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 1073741824" returned: 0 in 0.970s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:25 devstack sudo[83724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 Apr 10 18:25:25 devstack sudo[83724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:26 devstack sudo[83724]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Flow 'volume_create_manager' (3b658569-39c8-4310-9af1-b992ff672547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a033aac-e1ca-4527-ba35-0f321ad321e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269" returned: 0 in 0.650s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3600a463-8cf2-4227-bcc3-7772cfb4e45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682d32a0-5a7d-4102-85f8-1502b5782269', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df627f-79bd-4ae3-8a95-f0a820db1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a033aac-e1ca-4527-ba35-0f321ad321e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2069280362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963becc5-960c-4de0-acf3-4c6a4e323feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef93711d22f54d11b5bcf16e90fd819e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:26Z,use_quota=True,user_id='7e876aac9bcf4386a6384035633d9b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecaa435-9b6b-4a1f-8a4c-0b30b15d1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecaa435-9b6b-4a1f-8a4c-0b30b15d1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63df4da1-8ed7-4242-bfc6-348a59f28600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63df4da1-8ed7-4242-bfc6-348a59f28600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '963becc5-960c-4de0-acf3-4c6a4e323feb', 'volume_name': 'volume-963becc5-960c-4de0-acf3-4c6a4e323feb', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e581b626-5e7c-45df-9d0b-9e926a0340a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e581b626-5e7c-45df-9d0b-9e926a0340a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb72a42-924a-43cd-b0d0-5be5a44228c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:26 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Volume 963becc5-960c-4de0-acf3-4c6a4e323feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-963becc5-960c-4de0-acf3-4c6a4e323feb', 'volume_size': 1} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2069280362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=963becc5-960c-4de0-acf3-4c6a4e323feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef93711d22f54d11b5bcf16e90fd819e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:26Z,use_quota=True,user_id='7e876aac9bcf4386a6384035633d9b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Creating volume 963becc5-960c-4de0-acf3-4c6a4e323feb {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:26 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:26 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Volume volume-682d32a0-5a7d-4102-85f8-1502b5782269 (682d32a0-5a7d-4102-85f8-1502b5782269): created successfully Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df627f-79bd-4ae3-8a95-f0a820db1227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Flow 'volume_create_manager' (3cb188c1-2320-4214-8c65-03c78dcf5a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:26 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-714551c2-df88-49d8-851c-d17cbd22a40b tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Created volume successfully. Apr 10 18:25:26 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb 1073741824 Apr 10 18:25:26 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:26 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb 1073741824" returned: 0 in 0.727s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:26 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb Apr 10 18:25:26 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:27 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-af60b96d-c900-476c-a188-784f6b3e6b55 req-208fe0be-a55b-4c4c-ad57-605e4857a99b tempest-DeleteServersTestJSON-1909674459 None] Terminate volume connection completed successfully. Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-af60b96d-c900-476c-a188-784f6b3e6b55 req-208fe0be-a55b-4c4c-ad57-605e4857a99b tempest-DeleteServersTestJSON-1909674459 None] Deleting attachment c8fa546d-b244-4651-bd8e-6d292d1d9606. {{(pid=82020) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 18:25:27 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb" returned: 0 in 0.570s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb72a42-924a-43cd-b0d0-5be5a44228c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-963becc5-960c-4de0-acf3-4c6a4e323feb', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f4df60-d0c2-4be7-a01d-5c525054701b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:27 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Volume volume-963becc5-960c-4de0-acf3-4c6a4e323feb (963becc5-960c-4de0-acf3-4c6a4e323feb): created successfully Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f4df60-d0c2-4be7-a01d-5c525054701b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Flow 'volume_create_manager' (3b658569-39c8-4310-9af1-b992ff672547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:27 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f0484f73-c642-439c-bd6d-0b10e7e353ea tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Created volume successfully. Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e449396c-50ce-4141-b684-9cf58c84c7ca]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:27 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 Apr 10 18:25:27 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:28 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269" returned: 0 in 0.962s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514', 'name': 'volume-682d32a0-5a7d-4102-85f8-1502b5782269', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8196c224-9332-482c-ae25-6e621024984c', 'enforce_multipath': True} {{(pid=82020) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 18:25:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-a04b8c4d-680f-4c75-8234-c87e1ea73990 req-998bc383-9442-424d-b992-153bf8338f7a tempest-ServerBootFromVolumeStableRescueTest-291749077 None] attachment_update completed successfully. Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Acquiring lock "cinder-963becc5-960c-4de0-acf3-4c6a4e323feb-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "cinder-963becc5-960c-4de0-acf3-4c6a4e323feb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Acquiring lock "cinder-quobyte-963becc5-960c-4de0-acf3-4c6a4e323feb" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "cinder-quobyte-963becc5-960c-4de0-acf3-4c6a4e323feb" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b2e46-9835-45be-93ed-9b27f7a01b53]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:29 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb Apr 10 18:25:29 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:29 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb" returned: 0 in 0.705s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:29 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb Apr 10 18:25:29 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:30 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-963becc5-960c-4de0-acf3-4c6a4e323feb" returned: 0 in 0.511s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "cinder-quobyte-963becc5-960c-4de0-acf3-4c6a4e323feb" released by "delete_volume" :: held 1.242s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Created reservations ['92ddc6e2-8cbd-4e1b-a021-0638384f9105', '4bb8f60e-15f9-4cd6-ab94-16feb67ae26d', '771ad879-805b-4eb3-8bea-c53e818d3438', '79225b66-3489-493a-876b-17a5ddb1fea9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:30 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:25:30 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:30 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.576s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:25:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Deleted volume successfully. Apr 10 18:25:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aab96b1b-4523-48ed-9461-73fc11b93d06 tempest-VolumeQuotasNegativeTestJSON-1068592691 None] Lock "cinder-963becc5-960c-4de0-acf3-4c6a4e323feb-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Acquiring lock "cinder-38e03d44-c9b2-4bad-9de5-83b6cb2492bd-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Lock "cinder-38e03d44-c9b2-4bad-9de5-83b6cb2492bd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Acquiring lock "cinder-quobyte-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Lock "cinder-quobyte-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d416bcd-edb4-476a-9c5b-083be4f2a820]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:31 devstack sudo[83847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd Apr 10 18:25:31 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:31 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" returned: 0 in 0.688s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:31 devstack sudo[83854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd Apr 10 18:25:31 devstack sudo[83854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:32 devstack sudo[83854]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" returned: 0 in 0.709s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Lock "cinder-quobyte-38e03d44-c9b2-4bad-9de5-83b6cb2492bd" released by "delete_volume" :: held 1.442s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Created reservations ['5e833796-a78d-4081-a364-aea9006df087', 'fea52b89-2839-478a-b1aa-c78efca1a0b8', 'e66955f2-620e-4edb-b41f-14aea227ec95', '5a4019de-9a57-454d-94c0-ab6805688aa5'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:32 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:25:32 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:33 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.614s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:33 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:25:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Deleted volume successfully. Apr 10 18:25:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2e10285-644c-46a9-b196-bdc552a91800 tempest-DeleteServersTestJSON-1909674459 None] Lock "cinder-38e03d44-c9b2-4bad-9de5-83b6cb2492bd-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:25:42 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:UPDATE=57,cinder:SELECT=45,cinder:DELETE=6,cinder:INSERT=15 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:25:43 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=54,cinder:UPDATE=65,cinder:INSERT=11,cinder:DELETE=5 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Flow 'volume_create_manager' (5ec14d5a-9afb-4847-8a1b-e568a6ef6410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abdcb69-df96-4ccd-87ba-743da44d882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abdcb69-df96-4ccd-87ba-743da44d882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1050500029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4a171b-b790-4622-83c1-7e11d53e28b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bb430d75d48da9cfa6ad22db11ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:47Z,use_quota=True,user_id='f5f22215d7504e7e961fe6c8f0ab5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bff3ced-4a16-4aa1-832f-941566d7be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bff3ced-4a16-4aa1-832f-941566d7be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274aecea-9057-4072-a654-fe47f5b6e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274aecea-9057-4072-a654-fe47f5b6e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4a171b-b790-4622-83c1-7e11d53e28b5', 'volume_name': 'volume-4d4a171b-b790-4622-83c1-7e11d53e28b5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819c5364-b33e-48b8-8884-cb5a0bf4c5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819c5364-b33e-48b8-8884-cb5a0bf4c5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16587441-fa1c-4f80-a5b7-5dda8abee284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Volume 4d4a171b-b790-4622-83c1-7e11d53e28b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4a171b-b790-4622-83c1-7e11d53e28b5', 'volume_size': 1} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1050500029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4a171b-b790-4622-83c1-7e11d53e28b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bb430d75d48da9cfa6ad22db11ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:25:47Z,use_quota=True,user_id='f5f22215d7504e7e961fe6c8f0ab5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Creating volume 4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:25:47 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:47 devstack sudo[84255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 1073741824 Apr 10 18:25:47 devstack sudo[84255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:47 devstack sudo[84255]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 1073741824" returned: 0 in 0.741s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:47 devstack sudo[84285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 Apr 10 18:25:47 devstack sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:48 devstack sudo[84285]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5" returned: 0 in 0.543s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16587441-fa1c-4f80-a5b7-5dda8abee284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4a171b-b790-4622-83c1-7e11d53e28b5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b59bbaf-940c-439a-b97a-5faea2f24039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:25:48 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Volume volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 (4d4a171b-b790-4622-83c1-7e11d53e28b5): created successfully Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b59bbaf-940c-439a-b97a-5faea2f24039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:25:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Flow 'volume_create_manager' (5ec14d5a-9afb-4847-8a1b-e568a6ef6410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:25:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ea98bacc-a28c-450e-b38c-33243c67ec3c tempest-VolumesDeleteCascade-1074775189 None] Created volume successfully. Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Creating offline snapshot aa08ea0f-b7b5-4829-a8c7-e2b60728e6da of volume 4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b723fb3-e376-4811-9978-70a40a6911ba]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:49 devstack sudo[84302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 Apr 10 18:25:49 devstack sudo[84302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:49 devstack sudo[84302]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5" returned: 0 in 0.583s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:49 devstack sudo[84312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da 1G Apr 10 18:25:49 devstack sudo[84312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:50 devstack sudo[84312]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da 1G" returned: 0 in 0.618s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:50 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:25:50 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:51 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.530s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:51 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da is being set with open permissions: ugo+rw Apr 10 18:25:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:51 devstack sudo[84353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:25:51 devstack sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:51 devstack sudo[84353]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.535s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:51 devstack sudo[84359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info Apr 10 18:25:51 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:52 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info" returned: 0 in 0.522s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:52 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info is being set with open permissions: ugo+rw Apr 10 18:25:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:52 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info Apr 10 18:25:52 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:52 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.info" returned: 0 in 0.675s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.517s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9b2a56a9-368f-4922-9bee-f9246b75809a tempest-VolumesDeleteCascade-1074775189 None] Create snapshot completed successfully Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Creating offline snapshot 0e491419-33f2-4573-8970-2c5b4144b9a4 of volume 4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5148c77-9b57-4521-8700-6b7f535dd950]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:54 devstack sudo[84412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:25:54 devstack sudo[84412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:54 devstack sudo[84412]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.739s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4a171b-b790-4622-83c1-7e11d53e28b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:25:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:54 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 1G Apr 10 18:25:54 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:55 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 1G" returned: 0 in 0.788s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:55 devstack sudo[84440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 Apr 10 18:25:55 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:56 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4" returned: 0 in 0.704s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:56 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 is being set with open permissions: ugo+rw Apr 10 18:25:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:56 devstack sudo[84446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 Apr 10 18:25:56 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:56 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4" returned: 0 in 0.473s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:25:56 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-70a2dde1-78db-41b8-a4a5-3be7a1e624ab tempest-VolumesDeleteCascade-1074775189 None] Create snapshot completed successfully Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-4d4a171b-b790-4622-83c1-7e11d53e28b5-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-4d4a171b-b790-4622-83c1-7e11d53e28b5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Performing cascade delete. {{(pid=82020) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-0e491419-33f2-4573-8970-2c5b4144b9a4-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-0e491419-33f2-4573-8970-2c5b4144b9a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-0e491419-33f2-4573-8970-2c5b4144b9a4" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-0e491419-33f2-4573-8970-2c5b4144b9a4" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Deleting offline snapshot 0e491419-33f2-4573-8970-2c5b4144b9a4 of volume 4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] snapshot_file for this snap is: volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d1411-08b7-4158-88a1-43679fa95982]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:57 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 Apr 10 18:25:57 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:58 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4" returned: 0 in 0.680s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4a171b-b790-4622-83c1-7e11d53e28b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc193094-ba77-41d0-b3f8-b0bf7d375f36]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:58 devstack sudo[84495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:25:58 devstack sudo[84495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:58 devstack sudo[84495]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.764s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4a171b-b790-4622-83c1-7e11d53e28b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:25:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:58 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 Apr 10 18:25:58 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:25:59 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 10 18:25:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4" returned: 0 in 0.865s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:25:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:25:59 devstack sudo[84597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4 Apr 10 18:25:59 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:00 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.0e491419-33f2-4573-8970-2c5b4144b9a4" returned: 0 in 0.695s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-0e491419-33f2-4573-8970-2c5b4144b9a4" released by "_delete_snapshot" :: held 3.135s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" released by "delete_snapshot" :: held 3.145s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:00 devstack cinder-volume[82020]: WARNING cinder.quota [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Created reservations ['9cf0357b-f572-4904-a909-f45fdbf0fc44', '58dc529b-4835-437c-a0fb-ba3fb7ac7827', 'a8186b84-8fd9-4093-be08-a77a62afa01a', 'c95967a8-aebd-41de-855b-8cf352b7c2c1'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Delete snapshot completed successfully. Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-0e491419-33f2-4573-8970-2c5b4144b9a4-delete_snapshot" released by "delete_snapshot" :: held 3.445s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-aa08ea0f-b7b5-4829-a8c7-e2b60728e6da-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-aa08ea0f-b7b5-4829-a8c7-e2b60728e6da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Deleting offline snapshot aa08ea0f-b7b5-4829-a8c7-e2b60728e6da of volume 4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] snapshot_file for this snap is: volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[346b8877-6e20-4ac5-9a1b-49095b465861]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:00 devstack sudo[84656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:26:00 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:01 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.695s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4a171b-b790-4622-83c1-7e11d53e28b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:26:01 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[957061df-d8dd-4342-83a8-0f3123103140]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:01 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 Apr 10 18:26:01 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:02 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5" returned: 0 in 0.808s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:02 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:26:02 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:03 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.786s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:03 devstack sudo[84689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da Apr 10 18:26:03 devstack sudo[84689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:03 devstack sudo[84689]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5.aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" returned: 0 in 0.720s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-aa08ea0f-b7b5-4829-a8c7-e2b60728e6da" released by "_delete_snapshot" :: held 3.125s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" released by "delete_snapshot" :: held 3.140s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Created reservations ['8db7b69c-83de-4f76-89b3-858cfc45c11d', '0e7701b3-0b3f-4ace-93d0-2af1737b9180', 'cfd7575f-2faf-477d-9008-a6043710bc22', 'fca391fd-7817-4fdc-bcfc-bdb900b0813e'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Delete snapshot completed successfully. Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-aa08ea0f-b7b5-4829-a8c7-e2b60728e6da-delete_snapshot" released by "delete_snapshot" :: held 3.367s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Snapshots deleted, issuing volume delete {{(pid=82020) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" acquired by "delete_volume" :: waited 0.026s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[99621bab-07e5-46c4-971d-56ca5298f3aa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:04 devstack sudo[84703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 Apr 10 18:26:04 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:05 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5" returned: 0 in 1.025s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:05 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5 Apr 10 18:26:05 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:06 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d4a171b-b790-4622-83c1-7e11d53e28b5" returned: 0 in 0.725s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-4d4a171b-b790-4622-83c1-7e11d53e28b5" released by "delete_volume" :: held 1.891s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Created reservations ['a83ada22-c588-4dc9-96d2-bfd5e8d42051', '2b24d6b8-01b8-43e6-a5f8-00961e711ac9', 'f5fbba6d-adce-49a1-a2e0-906c99b950b3', '6ec9cb01-35dc-4f49-be60-1b0beef98d6b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:06 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:06 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:07 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.231s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:07 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Deleted volume successfully. Apr 10 18:26:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-568294ac-24be-420b-83f1-524765468a50 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-4d4a171b-b790-4622-83c1-7e11d53e28b5-delete_volume" released by "delete_volume" :: held 10.406s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:07 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Flow 'volume_create_manager' (c36ee763-aaa2-41ee-abfb-406c2e81578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188f9b10-3e24-4593-bfde-5efe6dead432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188f9b10-3e24-4593-bfde-5efe6dead432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2090076235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d258d47-480d-445a-b93b-b69c7f8158a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bb430d75d48da9cfa6ad22db11ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:08Z,use_quota=True,user_id='f5f22215d7504e7e961fe6c8f0ab5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cbfbda-96b8-4e6a-a05d-a74ecdcb29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cbfbda-96b8-4e6a-a05d-a74ecdcb29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a74922-115a-4cdb-91e0-0c6c847a92ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a74922-115a-4cdb-91e0-0c6c847a92ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d258d47-480d-445a-b93b-b69c7f8158a8', 'volume_name': 'volume-6d258d47-480d-445a-b93b-b69c7f8158a8', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440ba014-e960-42fc-9104-e51f4c48ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440ba014-e960-42fc-9104-e51f4c48ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a42125-38f8-44be-96fe-293d14a149f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:08 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Volume 6d258d47-480d-445a-b93b-b69c7f8158a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d258d47-480d-445a-b93b-b69c7f8158a8', 'volume_size': 1} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2090076235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d258d47-480d-445a-b93b-b69c7f8158a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bb430d75d48da9cfa6ad22db11ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:08Z,use_quota=True,user_id='f5f22215d7504e7e961fe6c8f0ab5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Creating volume 6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:08 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:26:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:08 devstack sudo[84738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 1073741824 Apr 10 18:26:08 devstack sudo[84738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:09 devstack sudo[84738]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 1073741824" returned: 0 in 1.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:09 devstack sudo[84780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:09 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:10 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 0.904s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a42125-38f8-44be-96fe-293d14a149f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d258d47-480d-445a-b93b-b69c7f8158a8', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18831029-4318-4a66-8d84-71115ad0aef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:10 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Volume volume-6d258d47-480d-445a-b93b-b69c7f8158a8 (6d258d47-480d-445a-b93b-b69c7f8158a8): created successfully Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18831029-4318-4a66-8d84-71115ad0aef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Flow 'volume_create_manager' (c36ee763-aaa2-41ee-abfb-406c2e81578a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-49aa4e72-ee7d-4e6c-83db-d8eb5a600d7c tempest-VolumesDeleteCascade-1074775189 None] Created volume successfully. Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Creating offline snapshot dca07c9b-5757-4838-905f-a61cbdc9ee6a of volume 6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[19af9a44-9d4d-44ed-9ae7-3577d575b8cd]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:11 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:11 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:11 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 0.583s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:11 devstack sudo[84799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a 1G Apr 10 18:26:11 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:13 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a 1G" returned: 0 in 1.199s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d258d47-480d-445a-b93b-b69c7f8158a8 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:13 devstack sudo[84805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d258d47-480d-445a-b93b-b69c7f8158a8 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a Apr 10 18:26:13 devstack sudo[84805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:13 devstack sudo[84805]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d258d47-480d-445a-b93b-b69c7f8158a8 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a" returned: 0 in 0.782s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:13 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a is being set with open permissions: ugo+rw Apr 10 18:26:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:13 devstack sudo[84812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a Apr 10 18:26:13 devstack sudo[84812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:14 devstack sudo[84812]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a" returned: 0 in 0.915s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:14 devstack sudo[84862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info Apr 10 18:26:14 devstack sudo[84862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:15 devstack sudo[84862]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info" returned: 0 in 0.986s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:15 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info is being set with open permissions: ugo+rw Apr 10 18:26:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:15 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info Apr 10 18:26:15 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:16 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.info" returned: 0 in 0.672s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.268s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:16 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-27caf7fd-6ebb-43d4-9ec6-7006cfc9e5fb tempest-VolumesDeleteCascade-1074775189 None] Create snapshot completed successfully Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:16 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:16 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:17 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.101s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Flow 'volume_create_manager' (de67ddfd-a14c-4f01-8f27-1067934fb6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360a96f0-7bb8-456b-b193-a3f42268b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360a96f0-7bb8-456b-b193-a3f42268b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-38538423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcba216-55ca-4260-b6d8-0a6ec829f41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3309ed08df6a45078d283a78659421f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:18Z,use_quota=True,user_id='c359d702044044f6b153bd2597522d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302fc73b-23a1-4f4d-abb5-bf528c7f7caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302fc73b-23a1-4f4d-abb5-bf528c7f7caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75f1155-0f45-4155-abcf-fe165819225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75f1155-0f45-4155-abcf-fe165819225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afcba216-55ca-4260-b6d8-0a6ec829f41f', 'volume_name': 'volume-afcba216-55ca-4260-b6d8-0a6ec829f41f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db89d6d2-a8de-4bb8-b15d-336587f99949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db89d6d2-a8de-4bb8-b15d-336587f99949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca9ade-2199-40eb-9aa5-fa45e3e80788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Volume afcba216-55ca-4260-b6d8-0a6ec829f41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afcba216-55ca-4260-b6d8-0a6ec829f41f', 'volume_size': 1} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-38538423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afcba216-55ca-4260-b6d8-0a6ec829f41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3309ed08df6a45078d283a78659421f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:18Z,use_quota=True,user_id='c359d702044044f6b153bd2597522d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Creating volume afcba216-55ca-4260-b6d8-0a6ec829f41f {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:18 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Flow 'volume_create_manager' (da5edb7f-bcf9-49a6-a62a-a704e0adb22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:18 devstack sudo[84908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f 1073741824 Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7817f45c-e811-47b3-9673-d7b687235518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7817f45c-e811-47b3-9673-d7b687235518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-565322475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba546683-4546-4fcb-abd3-25f9b7a4c177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08bb430d75d48da9cfa6ad22db11ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dca07c9b-5757-4838-905f-a61cbdc9ee6a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:18Z,use_quota=True,user_id='f5f22215d7504e7e961fe6c8f0ab5ce2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbed0b0-d44f-4157-be15-36f6535e8f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbed0b0-d44f-4157-be15-36f6535e8f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d9bb5f-e5de-4f47-b779-51930d35278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d9bb5f-e5de-4f47-b779-51930d35278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ba546683-4546-4fcb-abd3-25f9b7a4c177', 'volume_name': 'volume-ba546683-4546-4fcb-abd3-25f9b7a4c177', 'volume_size': 1, 'snapshot_id': 'dca07c9b-5757-4838-905f-a61cbdc9ee6a'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba6ddf3-90eb-40ac-b3f4-13c62497bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba6ddf3-90eb-40ac-b3f4-13c62497bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a1c6b0-8609-41d4-a35a-adbba30b0e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:18 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Volume ba546683-4546-4fcb-abd3-25f9b7a4c177: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ba546683-4546-4fcb-abd3-25f9b7a4c177', 'volume_size': 1, 'snapshot_id': 'dca07c9b-5757-4838-905f-a61cbdc9ee6a'} Apr 10 18:26:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:19 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f 1073741824" returned: 0 in 0.598s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:19 devstack sudo[84914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f Apr 10 18:26:19 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:20 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f" returned: 0 in 1.146s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.644s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-dca07c9b-5757-4838-905f-a61cbdc9ee6a-ba546683-4546-4fcb-abd3-25f9b7a4c177" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cca9ade-2199-40eb-9aa5-fa45e3e80788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afcba216-55ca-4260-b6d8-0a6ec829f41f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558ef8ac-7ab6-4b10-8690-9bca38991783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-dca07c9b-5757-4838-905f-a61cbdc9ee6a-ba546683-4546-4fcb-abd3-25f9b7a4c177" acquired by "_create_volume_from_snapshot" :: waited 0.079s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Creating volume ba546683-4546-4fcb-abd3-25f9b7a4c177 from snapshot dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-ba546683-4546-4fcb-abd3-25f9b7a4c177" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:20 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Volume volume-afcba216-55ca-4260-b6d8-0a6ec829f41f (afcba216-55ca-4260-b6d8-0a6ec829f41f): created successfully Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (558ef8ac-7ab6-4b10-8690-9bca38991783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Flow 'volume_create_manager' (de67ddfd-a14c-4f01-8f27-1067934fb6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-ba546683-4546-4fcb-abd3-25f9b7a4c177" acquired by "_copy_volume_from_snapshot" :: waited 0.079s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] snapshot: dca07c9b-5757-4838-905f-a61cbdc9ee6a, volume: ba546683-4546-4fcb-abd3-25f9b7a4c177, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:26:20 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-acd4e056-15b5-462f-bb40-d122c6144136 tempest-ServerRescueNegativeTestJSON-902992506 None] Created volume successfully. Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e833a3af-710b-46c9-97f8-696187c4dcaf]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:20 devstack sudo[84944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a Apr 10 18:26:20 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:21 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a" returned: 0 in 0.945s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d258d47-480d-445a-b93b-b69c7f8158a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:26:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:26:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:26:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b977a4d5-e748-4968-98bb-b9e9e79c11f0]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:21 devstack sudo[84953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:21 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:22 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 0.770s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:22 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:26:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:22 devstack sudo[84960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 Apr 10 18:26:22 devstack sudo[84960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:28 devstack sudo[84960]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177" returned: 0 in 5.593s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbcd744-c418-4e85-a12b-a1e6244226b6]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:28 devstack sudo[85069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:28 devstack sudo[85069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:29 devstack sudo[85069]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 1.241s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:29 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:26:29 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Converted 1024.00 MB image at 183.04 MB/s Apr 10 18:26:29 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 is being set with open permissions: ugo+rw Apr 10 18:26:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:29 devstack sudo[85084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 Apr 10 18:26:29 devstack sudo[85084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:30 devstack sudo[85084]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177" returned: 0 in 0.963s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-ba546683-4546-4fcb-abd3-25f9b7a4c177" released by "_copy_volume_from_snapshot" :: held 9.771s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-dca07c9b-5757-4838-905f-a61cbdc9ee6a-ba546683-4546-4fcb-abd3-25f9b7a4c177" released by "_create_volume_from_snapshot" :: held 9.875s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.955s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a1c6b0-8609-41d4-a35a-adbba30b0e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba546683-4546-4fcb-abd3-25f9b7a4c177', 'volume_size': 1, 'snapshot_id': 'dca07c9b-5757-4838-905f-a61cbdc9ee6a'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27988fbd-9c4f-40a7-99a2-e00c2c589774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:30 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Volume volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 (ba546683-4546-4fcb-abd3-25f9b7a4c177): created successfully Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27988fbd-9c4f-40a7-99a2-e00c2c589774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Flow 'volume_create_manager' (da5edb7f-bcf9-49a6-a62a-a704e0adb22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-cadb0584-3233-4cbc-af76-d45afc159981 tempest-VolumesDeleteCascade-1074775189 None] Created volume successfully. Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-6d258d47-480d-445a-b93b-b69c7f8158a8-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-6d258d47-480d-445a-b93b-b69c7f8158a8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Performing cascade delete. {{(pid=82020) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-dca07c9b-5757-4838-905f-a61cbdc9ee6a-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-dca07c9b-5757-4838-905f-a61cbdc9ee6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-6d258d47-480d-445a-b93b-b69c7f8158a8" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-6d258d47-480d-445a-b93b-b69c7f8158a8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-dca07c9b-5757-4838-905f-a61cbdc9ee6a" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-dca07c9b-5757-4838-905f-a61cbdc9ee6a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Deleting offline snapshot dca07c9b-5757-4838-905f-a61cbdc9ee6a of volume 6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] snapshot_file for this snap is: volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e866ff-a32f-463f-b4e8-80d4e365a1d6]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:31 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a Apr 10 18:26:31 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:32 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a" returned: 0 in 0.959s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d258d47-480d-445a-b93b-b69c7f8158a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:26:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab68f452-4d40-474c-85a8-b648cdf186f5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:32 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:32 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:33 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 1.159s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:33 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a Apr 10 18:26:33 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:33 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Flow 'volume_create_manager' (60d2a554-eedb-4056-9678-9ae15d3b8c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f85024-d57b-4110-8e91-c0167c33f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f85024-d57b-4110-8e91-c0167c33f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-14223863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb2c612-cdae-4a42-9f3e-5904a4ead9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e934571bd80141f28c76e6fa3d56f6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:34Z,use_quota=True,user_id='ec4ef25c650042eab4de24f380164324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d0dcce-7866-4436-9772-c2269ae32cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d0dcce-7866-4436-9772-c2269ae32cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc54f27-a0a1-462e-b4a2-7f62e674e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc54f27-a0a1-462e-b4a2-7f62e674e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb2c612-cdae-4a42-9f3e-5904a4ead9f4', 'volume_name': 'volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb912d5-1a4c-48c7-832a-f798f0337651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb912d5-1a4c-48c7-832a-f798f0337651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ec681e-5e6e-4d96-9ae6-d1fc743c005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:34 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Volume fcb2c612-cdae-4a42-9f3e-5904a4ead9f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4', 'volume_size': 1} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-14223863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb2c612-cdae-4a42-9f3e-5904a4ead9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e934571bd80141f28c76e6fa3d56f6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:34Z,use_quota=True,user_id='ec4ef25c650042eab4de24f380164324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Creating volume fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:34 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:26:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:34 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 1073741824 Apr 10 18:26:34 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:35 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a" returned: 0 in 1.277s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:35 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a Apr 10 18:26:35 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:35 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 1073741824" returned: 0 in 1.137s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:35 devstack sudo[85169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 Apr 10 18:26:35 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:35 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8.dca07c9b-5757-4838-905f-a61cbdc9ee6a" returned: 0 in 0.653s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-dca07c9b-5757-4838-905f-a61cbdc9ee6a" released by "_delete_snapshot" :: held 4.322s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-6d258d47-480d-445a-b93b-b69c7f8158a8" released by "delete_snapshot" :: held 4.365s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:35 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4" returned: 0 in 0.645s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ec681e-5e6e-4d96-9ae6-d1fc743c005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3112b79c-58b6-44ee-9fc6-dbd53d18fb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Created reservations ['460fa138-acd5-4266-9784-df9a57ac8d14', '1484adda-795b-42c5-ada2-2e0793b80e86', '3590c6c3-4433-4a61-be43-534dbb42a37b', '4718aa21-9e58-4989-b6dc-7b92822868ff'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:36 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Volume volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 (fcb2c612-cdae-4a42-9f3e-5904a4ead9f4): created successfully Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3112b79c-58b6-44ee-9fc6-dbd53d18fb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Flow 'volume_create_manager' (60d2a554-eedb-4056-9678-9ae15d3b8c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Delete snapshot completed successfully. Apr 10 18:26:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9e8d33e4-a4dd-4861-b356-babb700fb36a tempest-ServersNegativeTestJSON-1773223046 None] Created volume successfully. Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-dca07c9b-5757-4838-905f-a61cbdc9ee6a-delete_snapshot" released by "delete_snapshot" :: held 4.608s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Snapshots deleted, issuing volume delete {{(pid=82020) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-6d258d47-480d-445a-b93b-b69c7f8158a8" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-6d258d47-480d-445a-b93b-b69c7f8158a8" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[066accbb-a869-4995-b5d0-0b1884a82f6a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:36 devstack sudo[85207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:36 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:37 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 1.075s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:37 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8 Apr 10 18:26:37 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Flow 'volume_create_manager' (bae0a9cf-a40d-4b7c-9bd8-3885af1ee573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b4b3f8-0100-4444-bc56-35c9c6ea38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b4b3f8-0100-4444-bc56-35c9c6ea38db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1609838084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c776db5e-ca26-43c6-8b5e-06f8bb20da68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e934571bd80141f28c76e6fa3d56f6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:38Z,use_quota=True,user_id='ec4ef25c650042eab4de24f380164324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d109d6-e21c-4166-8a5f-f5a6e8a0a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d109d6-e21c-4166-8a5f-f5a6e8a0a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c011bc4-9de4-471c-b1f4-e214d0c72c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c011bc4-9de4-471c-b1f4-e214d0c72c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c776db5e-ca26-43c6-8b5e-06f8bb20da68', 'volume_name': 'volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:38 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c224cb-2057-462d-9255-034a304d4107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c224cb-2057-462d-9255-034a304d4107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e3fe26-b01c-48ea-8746-ed3c341adde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:38 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Volume c776db5e-ca26-43c6-8b5e-06f8bb20da68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68', 'volume_size': 1} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1609838084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c776db5e-ca26-43c6-8b5e-06f8bb20da68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e934571bd80141f28c76e6fa3d56f6c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:38Z,use_quota=True,user_id='ec4ef25c650042eab4de24f380164324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Creating volume c776db5e-ca26-43c6-8b5e-06f8bb20da68 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:38 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6d258d47-480d-445a-b93b-b69c7f8158a8" returned: 0 in 1.131s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:38 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 1073741824 Apr 10 18:26:38 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-6d258d47-480d-445a-b93b-b69c7f8158a8" released by "delete_volume" :: held 2.325s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Created reservations ['430b4408-d63e-47d2-b0a8-34aa4ba83402', '9f6b556c-2212-4077-9fbe-9872413f068c', '441d9f92-b60e-4b61-8b6c-19dec99c474c', '890b8c53-8bf3-4356-8074-de6e5f1988b2'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:38 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:38 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:39 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 1073741824" returned: 0 in 1.295s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:39 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 Apr 10 18:26:39 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:39 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.258s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:39 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:39 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Deleted volume successfully. Apr 10 18:26:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-ba546683-4546-4fcb-abd3-25f9b7a4c177-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-ba546683-4546-4fcb-abd3-25f9b7a4c177-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fcc6ba59-b7ac-4250-a33e-3721710a0021 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-6d258d47-480d-445a-b93b-b69c7f8158a8-delete_volume" released by "delete_volume" :: held 8.743s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "cinder-quobyte-ba546683-4546-4fcb-abd3-25f9b7a4c177" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-ba546683-4546-4fcb-abd3-25f9b7a4c177" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:40 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b6369-5863-401a-8111-f1b6de52c680]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:40 devstack sudo[85276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 Apr 10 18:26:40 devstack sudo[85276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:41 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68" returned: 0 in 1.629s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] <== create_volume: return (2985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e3fe26-b01c-48ea-8746-ed3c341adde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4075b6c4-6ffa-4de0-b53b-2e53069101ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:41 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Volume volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 (c776db5e-ca26-43c6-8b5e-06f8bb20da68): created successfully Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4075b6c4-6ffa-4de0-b53b-2e53069101ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Flow 'volume_create_manager' (bae0a9cf-a40d-4b7c-9bd8-3885af1ee573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:41 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7f311e2f-eed8-4acf-b773-e45eb6ee67e6 tempest-ServersNegativeTestJSON-1773223046 None] Created volume successfully. Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Flow 'volume_create_manager' (2cbed001-ac00-4c72-82ff-cb388c83c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf91a70-99c1-408a-9877-35ebe980c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf91a70-99c1-408a-9877-35ebe980c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dba5d2-1d7f-40c1-95bf-2fea34bca216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b4be2913fb44b19590ab44546a925a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:42Z,use_quota=True,user_id='cefb4217ea3c4d54b515cfc0b44ebf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442ab776-2265-4187-ae54-980dc4d07a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442ab776-2265-4187-ae54-980dc4d07a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e957d04-38b8-4390-a981-eba6eb0d8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:41 devstack cinder-volume[82020]: DEBUG cinder.image.glance [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Creating Keystone auth plugin from conf {{(pid=82020) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 18:26:42 devstack sudo[85276]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177" returned: 0 in 2.189s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e957d04-38b8-4390-a981-eba6eb0d8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0dba5d2-1d7f-40c1-95bf-2fea34bca216', 'volume_name': 'volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803b50c8-e74c-450a-a709-97267ea69c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803b50c8-e74c-450a-a709-97267ea69c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2845aa63-aa78-4d61-a43f-1b761fbfb7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:42 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Volume f0dba5d2-1d7f-40c1-95bf-2fea34bca216: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 18:26:42 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Trying to clone f0dba5d2-1d7f-40c1-95bf-2fea34bca216 from image efad70a4-2f7f-4812-890b-f0ef460d14cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]). {{(pid=82020) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 18:26:42 devstack sudo[85286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177 Apr 10 18:26:42 devstack sudo[85286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Acquiring lock "cinder-afcba216-55ca-4260-b6d8-0a6ec829f41f-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 18:26:43 devstack cinder-volume[82020]: INFO cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Image download 20.69 MB at 20.69 MB/s Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "cinder-afcba216-55ca-4260-b6d8-0a6ec829f41f-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:UPDATE=65,cinder:SELECT=46,cinder:INSERT=14,cinder:DELETE=5 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff785b8-b1d6-444e-9443-a2c15427e517]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Acquiring lock "cinder-quobyte-afcba216-55ca-4260-b6d8-0a6ec829f41f" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "cinder-quobyte-afcba216-55ca-4260-b6d8-0a6ec829f41f" acquired by "delete_volume" :: waited 0.025s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec00140e-38c3-4e7e-b5d7-1bc0ea19245b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:43 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD Apr 10 18:26:43 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:43 devstack sudo[85311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f Apr 10 18:26:43 devstack sudo[85311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "cinder-c776db5e-ca26-43c6-8b5e-06f8bb20da68-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-c776db5e-ca26-43c6-8b5e-06f8bb20da68-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "cinder-quobyte-c776db5e-ca26-43c6-8b5e-06f8bb20da68" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-quobyte-c776db5e-ca26-43c6-8b5e-06f8bb20da68" acquired by "delete_volume" :: waited 0.038s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b3a24-c810-424f-add7-d6ec214a8031]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:44 devstack sudo[85286]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ba546683-4546-4fcb-abd3-25f9b7a4c177" returned: 0 in 1.726s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-quobyte-ba546683-4546-4fcb-abd3-25f9b7a4c177" released by "delete_volume" :: held 4.086s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=58,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=13 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:26:44 devstack sudo[85315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 Apr 10 18:26:44 devstack sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Created reservations ['09f85343-03dd-4672-b283-573f063a5439', '16393611-bfcc-49dc-80aa-cbe627f24686', '030cafd0-f39e-4e24-ab1e-2ee2fcfed6b2', '9be2cab5-3c61-4ea8-98d4-bb6d9d694198'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:44 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD" returned: 0 in 1.218s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf is fetched for user cefb4217ea3c4d54b515cfc0b44ebf84. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c070f-22a0-45fc-8450-14f0002f8d8f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:44 devstack sudo[85321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:44 devstack sudo[85321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:44 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD Apr 10 18:26:44 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:45 devstack sudo[85311]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f" returned: 0 in 1.865s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:45 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f Apr 10 18:26:45 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:45 devstack sudo[85315]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68" returned: 0 in 1.805s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:45 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68 Apr 10 18:26:45 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:46 devstack sudo[85321]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:46 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Deleted volume successfully. Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6993b574-9c81-456b-9fce-4196bd1a6dc8 tempest-VolumesDeleteCascade-1074775189 None] Lock "cinder-ba546683-4546-4fcb-abd3-25f9b7a4c177-delete_volume" released by "delete_volume" :: held 6.350s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:46 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD" returned: 0 in 1.866s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dba5d2-1d7f-40c1-95bf-2fea34bca216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39b4be2913fb44b19590ab44546a925a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:42Z,use_quota=True,user_id='cefb4217ea3c4d54b515cfc0b44ebf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Creating volume f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:46 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:46 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 1073741824 Apr 10 18:26:46 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:46 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-afcba216-55ca-4260-b6d8-0a6ec829f41f" returned: 0 in 1.557s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "cinder-quobyte-afcba216-55ca-4260-b6d8-0a6ec829f41f" released by "delete_volume" :: held 3.538s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:46 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Created reservations ['ab87d112-7b47-4055-9e51-be366636ec5a', 'c05ccb67-d310-4e6b-915a-a63a9edf6adf', '6e11b8e3-3e88-43ae-83a2-d19150863850', '10a45c50-bc8c-4930-8777-6787482fde88'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:47 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:47 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:47 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c776db5e-ca26-43c6-8b5e-06f8bb20da68" returned: 0 in 1.323s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-quobyte-c776db5e-ca26-43c6-8b5e-06f8bb20da68" released by "delete_volume" :: held 3.215s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Created reservations ['1ff74de2-3750-4a3f-8719-cf82fec74e17', '4473203f-3b90-4d6c-ae48-5fe0a08eb1a7', '1f56f98b-5c6b-4a8b-bb62-6955a7b4a0d0', '4721855c-9aaa-4e73-964f-66ad62ad8fdb'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:47 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:47 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "cinder-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "cinder-quobyte-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-quobyte-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c2ab0c-4215-4cc8-9608-06028661441e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:48 devstack sudo[85353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 Apr 10 18:26:48 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:48 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 1073741824" returned: 0 in 1.743s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:48 devstack sudo[85356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:26:48 devstack sudo[85356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:48 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.766s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Deleted volume successfully. Apr 10 18:26:48 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2a7ae269-8b92-42f0-8080-fb9e9053ddb8 tempest-ServerRescueNegativeTestJSON-902992506 None] Lock "cinder-afcba216-55ca-4260-b6d8-0a6ec829f41f-delete_volume" released by "delete_volume" :: held 5.763s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:48 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Deleted volume successfully. Apr 10 18:26:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b8be39d7-8cab-4293-ab1b-bc4a1816bdbd tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-c776db5e-ca26-43c6-8b5e-06f8bb20da68-delete_volume" released by "delete_volume" :: held 5.140s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:49 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4" returned: 0 in 1.685s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:49 devstack sudo[85385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4 Apr 10 18:26:49 devstack sudo[85385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:50 devstack sudo[85356]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 0 in 2.200s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] <== create_volume: return (4039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.042s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Attempting download of efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume f0dba5d2-1d7f-40c1-95bf-2fea34bca216. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e2949-7d74-4ec4-9a3c-30fbe43cdf6c]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:50 devstack sudo[85385]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4" returned: 0 in 1.333s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-quobyte-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4" released by "delete_volume" :: held 3.103s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Created reservations ['2d949848-42b5-40b1-a631-b511dd21729b', 'f63ff529-9f99-4f83-ae13-6663eb853488', '4f217ffe-a6af-4fbf-95ec-fee0b8cffe17', '47837374-17e3-4609-92fd-7c7b7252706c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:51 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk Apr 10 18:26:51 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:51 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:51 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:52 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk" returned: 0 in 1.394s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Flow 'volume_create_manager' (3029e2c2-9763-4b9c-a0ba-49674b0c7704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:52 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk Apr 10 18:26:52 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046c85ef-68c3-4e02-916b-4dcbb7001213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (046c85ef-68c3-4e02-916b-4dcbb7001213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1993331703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5ca766-cb63-4402-8b99-992ac2b3baaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104a0d9339ad4ebf924d88f3c30810fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:52Z,use_quota=True,user_id='d5927672f71943e2b222b838b52e9860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1438f639-e2ea-44da-8b7b-bd3f83a3b83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1438f639-e2ea-44da-8b7b-bd3f83a3b83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d909d7d-1a0a-440c-8076-39d15c3be7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d909d7d-1a0a-440c-8076-39d15c3be7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf5ca766-cb63-4402-8b99-992ac2b3baaf', 'volume_name': 'volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ba0e6-9dc0-4dd0-9fe1-1a2f36495922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8ba0e6-9dc0-4dd0-9fe1-1a2f36495922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71f32d5-1bd7-4ca7-b1e4-f0e79f4c06ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:52 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Volume cf5ca766-cb63-4402-8b99-992ac2b3baaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf', 'volume_size': 1} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1993331703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf5ca766-cb63-4402-8b99-992ac2b3baaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104a0d9339ad4ebf924d88f3c30810fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:26:52Z,use_quota=True,user_id='d5927672f71943e2b222b838b52e9860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Creating volume cf5ca766-cb63-4402-8b99-992ac2b3baaf {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:26:52 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:52 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf 1073741824 Apr 10 18:26:52 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:52 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Deleted volume successfully. Apr 10 18:26:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-830ca81a-7bb5-45e4-ae3e-3f361dd94f25 tempest-ServersNegativeTestJSON-1773223046 None] Lock "cinder-fcb2c612-cdae-4a42-9f3e-5904a4ead9f4-delete_volume" released by "delete_volume" :: held 4.960s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:53 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk" returned: 1 in 1.126s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf__b32fngk' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:26:53 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5158f45-71c4-44e6-8d9f-abd79f11ae86]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:53 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD Apr 10 18:26:53 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:53 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf 1073741824" returned: 0 in 1.319s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:53 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf Apr 10 18:26:53 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:54 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD" returned: 0 in 0.848s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] efad70a4-2f7f-4812-890b-f0ef460d14cf was qcow2, converting to raw {{(pid=82020) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:54 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:26:54 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:54 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf" returned: 0 in 0.610s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71f32d5-1bd7-4ca7-b1e4-f0e79f4c06ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93c8114-d423-46b1-a14e-342be0e46aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:54 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Volume volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf (cf5ca766-cb63-4402-8b99-992ac2b3baaf): created successfully Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93c8114-d423-46b1-a14e-342be0e46aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Flow 'volume_create_manager' (3029e2c2-9763-4b9c-a0ba-49674b0c7704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1bba30ec-863e-48f3-9d56-153b45ba07ae tempest-VolumesMetadataTest-341453896 None] Created volume successfully. Apr 10 18:26:55 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 0 in 1.479s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:55 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_fnwiz__1devstack@QuobyteHD, size 112.00 MB, duration 1.48 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:26:55 devstack cinder-volume[82020]: INFO cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Converted 112.00 MB image at 75.68 MB/s Apr 10 18:26:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:55 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 1G Apr 10 18:26:55 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Acquiring lock "cinder-cf5ca766-cb63-4402-8b99-992ac2b3baaf-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Lock "cinder-cf5ca766-cb63-4402-8b99-992ac2b3baaf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Acquiring lock "cinder-quobyte-cf5ca766-cb63-4402-8b99-992ac2b3baaf" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Lock "cinder-quobyte-cf5ca766-cb63-4402-8b99-992ac2b3baaf" acquired by "delete_volume" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af65f8-1aa2-40ab-9d30-3aafb3d73052]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:56 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 1G" returned: 0 in 0.891s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:56 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf Apr 10 18:26:56 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed4530a-8b22-40bc-9472-302c704b2935]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:26:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:56 devstack sudo[85494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:26:56 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:57 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf" returned: 0 in 0.726s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:57 devstack sudo[85500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf Apr 10 18:26:57 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:57 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 0 in 0.737s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:57 devstack sudo[85504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:26:57 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:57 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cf5ca766-cb63-4402-8b99-992ac2b3baaf" returned: 0 in 0.559s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Lock "cinder-quobyte-cf5ca766-cb63-4402-8b99-992ac2b3baaf" released by "delete_volume" :: held 1.404s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Created reservations ['c8d23111-a25c-40e5-806c-6ed594ab7800', '338cdee5-65d2-4659-a3ea-d47443087a3b', 'd015906e-cc45-44c3-9eea-96f2633ad0ab', '87914c5e-5263-4ac3-a7aa-f324dc9f1307'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:26:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:26:57 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:26:57 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:26:58 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 1 in 0.825s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Downloaded image efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume f0dba5d2-1d7f-40c1-95bf-2fea34bca216 successfully. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf for user cefb4217ea3c4d54b515cfc0b44ebf84 is deleted. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Marking volume f0dba5d2-1d7f-40c1-95bf-2fea34bca216 as bootable. {{(pid=82020) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Copying metadata from image efad70a4-2f7f-4812-890b-f0ef460d14cf to f0dba5d2-1d7f-40c1-95bf-2fea34bca216. {{(pid=82020) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Creating volume glance metadata for volume f0dba5d2-1d7f-40c1-95bf-2fea34bca216 backed by image efad70a4-2f7f-4812-890b-f0ef460d14cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82020) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2845aa63-aa78-4d61-a43f-1b761fbfb7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e46b2a-052b-4c62-8060-78439bdfde12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:26:58 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Volume volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 (f0dba5d2-1d7f-40c1-95bf-2fea34bca216): created successfully Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e46b2a-052b-4c62-8060-78439bdfde12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Flow 'volume_create_manager' (2cbed001-ac00-4c72-82ff-cb388c83c183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:26:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-7ba7695b-0189-419d-822f-c86cf995cabb tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Created volume successfully. Apr 10 18:26:58 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.651s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:26:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Deleted volume successfully. Apr 10 18:26:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-afc553b4-2473-4e28-a20d-72a67a191e4f tempest-VolumesMetadataTest-341453896 None] Lock "cinder-cf5ca766-cb63-4402-8b99-992ac2b3baaf-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:00 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6ff26-8678-4d10-b19b-6ec1df58ba49]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:01 devstack sudo[85554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:27:01 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:01 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 0 in 0.725s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:01 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:27:01 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:01 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Flow 'volume_create_manager' (7a55f0fd-4b40-4dd6-b5d2-d6b6a3208aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3ff009-dd34-4839-941e-e1bed8f692e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c3ff009-dd34-4839-941e-e1bed8f692e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1855071699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676fc0a3-58d2-4f14-af84-e771e9ed24c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59eb639b49f4138b2c70fc13d20ba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:02Z,use_quota=True,user_id='5c3e6e4cfad74b5f83c77250409f43c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843f0ed9-b0bb-4610-a900-a192ca9f8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843f0ed9-b0bb-4610-a900-a192ca9f8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842e3aea-335f-42b1-b69a-b1c1a010f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842e3aea-335f-42b1-b69a-b1c1a010f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676fc0a3-58d2-4f14-af84-e771e9ed24c0', 'volume_name': 'volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4c0364-cf98-4063-bead-970b3f52dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4c0364-cf98-4063-bead-970b3f52dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65077160-3d30-448c-acc9-0673edfbbe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Volume 676fc0a3-58d2-4f14-af84-e771e9ed24c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0', 'volume_size': 1} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:02 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 1 in 0.727s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.489s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1855071699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676fc0a3-58d2-4f14-af84-e771e9ed24c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59eb639b49f4138b2c70fc13d20ba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:02Z,use_quota=True,user_id='5c3e6e4cfad74b5f83c77250409f43c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Creating volume 676fc0a3-58d2-4f14-af84-e771e9ed24c0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:02 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:02 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 1073741824 Apr 10 18:27:02 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514', 'name': 'volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ec73d71-bc50-4513-96a2-a782cd3ec09b', 'enforce_multipath': True} {{(pid=82020) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 18:27:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-f501abe0-cbeb-4025-b0d5-4882e66e276b req-2ac4e390-5651-4f82-b643-d4ff51ee4f85 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] attachment_update completed successfully. Apr 10 18:27:03 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 1073741824" returned: 0 in 0.719s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:03 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 Apr 10 18:27:03 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:03 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0" returned: 0 in 0.644s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65077160-3d30-448c-acc9-0673edfbbe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1937854e-70ca-4f98-a8bb-e61af97d10f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Volume volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 (676fc0a3-58d2-4f14-af84-e771e9ed24c0): created successfully Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1937854e-70ca-4f98-a8bb-e61af97d10f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Flow 'volume_create_manager' (7a55f0fd-4b40-4dd6-b5d2-d6b6a3208aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7aab275f-49b6-4afb-a316-e72b7864f88e tempest-VolumesTransfersV355Test-701099849 None] Created volume successfully. Apr 10 18:27:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1df032e4-d230-4899-b1cf-0dc41f9de4d8 tempest-VolumesTransfersV355Test-1085550568 None] Transfer volume completed successfully. Apr 10 18:27:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-17eff319-6037-4998-85ef-22d318cc8220 tempest-GroupSnapshotsTest-866023021 None] Group tempest-GroupSnapshotsTest-Group-1780938791: creating Apr 10 18:27:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-17eff319-6037-4998-85ef-22d318cc8220 tempest-GroupSnapshotsTest-866023021 None] Group tempest-GroupSnapshotsTest-Group-1780938791: created successfully Apr 10 18:27:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-17eff319-6037-4998-85ef-22d318cc8220 tempest-GroupSnapshotsTest-866023021 None] Create group completed successfully. Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Acquiring lock "cinder-676fc0a3-58d2-4f14-af84-e771e9ed24c0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-676fc0a3-58d2-4f14-af84-e771e9ed24c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Acquiring lock "cinder-quobyte-676fc0a3-58d2-4f14-af84-e771e9ed24c0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-quobyte-676fc0a3-58d2-4f14-af84-e771e9ed24c0" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd09e490-d7ae-4b47-a434-7d315d94d1ee]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:05 devstack sudo[85574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 Apr 10 18:27:05 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:05 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0" returned: 0 in 0.629s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:06 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0 Apr 10 18:27:06 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (ff02322c-83ba-4ee5-89d7-747797d27cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e747bc80-d38a-4db5-bbf2-999749e94d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e747bc80-d38a-4db5-bbf2-999749e94d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835557846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=364fcb4a-ec2a-47c5-8793-7fc7f322773e,host='devstack@QuobyteHD#QuobyteHD',id=5e5c6080-e122-4c00-b881-1c0a67e19636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:06Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b05dd224-ec83-4a1b-a7f0-f465ad1eaa42),volume_type_id=b05dd224-ec83-4a1b-a7f0-f465ad1eaa42)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bbd777-a5c2-4d1b-99c4-173c47edfc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5bbd777-a5c2-4d1b-99c4-173c47edfc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305a8d4-247c-4b06-a285-34c90ee15d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5305a8d4-247c-4b06-a285-34c90ee15d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5c6080-e122-4c00-b881-1c0a67e19636', 'volume_name': 'volume-5e5c6080-e122-4c00-b881-1c0a67e19636', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729f7d52-6fcb-4390-a310-65e53987037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729f7d52-6fcb-4390-a310-65e53987037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740236f6-8a96-45c2-a7b3-89c2915b17a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:06 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Volume 5e5c6080-e122-4c00-b881-1c0a67e19636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5c6080-e122-4c00-b881-1c0a67e19636', 'volume_size': 1} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=364fcb4a-ec2a-47c5-8793-7fc7f322773e,created_at=2026-04-10T16:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1835557846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=364fcb4a-ec2a-47c5-8793-7fc7f322773e,host='devstack@QuobyteHD#QuobyteHD',id=5e5c6080-e122-4c00-b881-1c0a67e19636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:06Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b05dd224-ec83-4a1b-a7f0-f465ad1eaa42),volume_type_id=b05dd224-ec83-4a1b-a7f0-f465ad1eaa42)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Creating volume 5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:06 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:06 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 1073741824 Apr 10 18:27:06 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:06 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-676fc0a3-58d2-4f14-af84-e771e9ed24c0" returned: 0 in 0.543s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-quobyte-676fc0a3-58d2-4f14-af84-e771e9ed24c0" released by "delete_volume" :: held 1.208s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Created reservations ['2eb985de-cc33-4781-a07c-c71a523e33f4', '0795018f-af4a-45ab-a8b6-bddc0622359c', 'f99d90bd-70ff-4a51-9cce-50170a7a8a37', '67973084-26c5-4938-be25-87452ee7a939'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:06 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:06 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:06 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 1073741824" returned: 0 in 0.557s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:06 devstack sudo[85593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:06 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:07 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.630s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Deleted volume successfully. Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-97b773ea-63ce-4249-90bf-2d29a0e804f3 tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-676fc0a3-58d2-4f14-af84-e771e9ed24c0-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:07 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.603s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (740236f6-8a96-45c2-a7b3-89c2915b17a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5c6080-e122-4c00-b881-1c0a67e19636', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25766ace-d9a2-4a8e-9878-46ecf47febf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:07 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Volume volume-5e5c6080-e122-4c00-b881-1c0a67e19636 (5e5c6080-e122-4c00-b881-1c0a67e19636): created successfully Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25766ace-d9a2-4a8e-9878-46ecf47febf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (ff02322c-83ba-4ee5-89d7-747797d27cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e2c7938b-65ca-43a1-99d2-d991f3efc6ed tempest-GroupSnapshotsTest-866023021 None] Created volume successfully. Apr 10 18:27:07 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Flow 'volume_create_manager' (179f1a43-8cd8-4628-a02e-e5ac59c66465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9e5df3-542e-42a0-a252-a729dcc2db64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9e5df3-542e-42a0-a252-a729dcc2db64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-86944657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1297b5a3-71ac-4fca-aa1c-e129b737131c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59eb639b49f4138b2c70fc13d20ba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:08Z,use_quota=True,user_id='5c3e6e4cfad74b5f83c77250409f43c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e188958b-9892-4aaf-bf68-46c2b38463a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e188958b-9892-4aaf-bf68-46c2b38463a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd56677-9eb2-483a-a3d6-419032c99cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd56677-9eb2-483a-a3d6-419032c99cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1297b5a3-71ac-4fca-aa1c-e129b737131c', 'volume_name': 'volume-1297b5a3-71ac-4fca-aa1c-e129b737131c', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7388e5f2-1258-4a88-9910-c60eda10bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7388e5f2-1258-4a88-9910-c60eda10bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f8cdf2-cda8-4178-a60e-2ea6e9eb5bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:08 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Volume 1297b5a3-71ac-4fca-aa1c-e129b737131c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1297b5a3-71ac-4fca-aa1c-e129b737131c', 'volume_size': 1} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-86944657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1297b5a3-71ac-4fca-aa1c-e129b737131c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59eb639b49f4138b2c70fc13d20ba7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:08Z,use_quota=True,user_id='5c3e6e4cfad74b5f83c77250409f43c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Creating volume 1297b5a3-71ac-4fca-aa1c-e129b737131c {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:08 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:08 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c 1073741824 Apr 10 18:27:08 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] GroupSnapshot f074e4b9-32db-40ad-a843-d21b9ccef37a: creating. Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Group snapshot f074e4b9-32db-40ad-a843-d21b9ccef37a: creating. {{(pid=82020) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:08 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c 1073741824" returned: 0 in 0.894s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:09 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c Apr 10 18:27:09 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Flow 'volume_create_manager' (1607b2a7-75de-456e-a1c4-3829f16bac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca64ac61-de32-409b-a822-486afa62101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca64ac61-de32-409b-a822-486afa62101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1588010402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec0ad10-560d-40fa-9679-648e0fc1a047,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ea97e994f445fc924a33ec30bbe150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:09Z,use_quota=True,user_id='8de39d95238a42828c5b4b8f5ba0c23c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca09274-abf8-4d10-bbb7-b19b79ae17cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca09274-abf8-4d10-bbb7-b19b79ae17cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782fcb6a-21db-4bef-a618-bd23375f280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782fcb6a-21db-4bef-a618-bd23375f280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ec0ad10-560d-40fa-9679-648e0fc1a047', 'volume_name': 'volume-2ec0ad10-560d-40fa-9679-648e0fc1a047', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fce28e-4579-4815-9c83-98190c9a5073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39fce28e-4579-4815-9c83-98190c9a5073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9a38f3-121d-4886-bc8a-113740dafa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:09 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Volume 2ec0ad10-560d-40fa-9679-648e0fc1a047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ec0ad10-560d-40fa-9679-648e0fc1a047', 'volume_size': 1} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:09 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c" returned: 0 in 0.592s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.766s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Creating offline snapshot 59c96c0a-0796-4887-9865-da107a2cb18f of volume 5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f8cdf2-cda8-4178-a60e-2ea6e9eb5bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1297b5a3-71ac-4fca-aa1c-e129b737131c', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7230a01d-b194-46dd-9e0e-4dd6d18fea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e7320-54e3-4eb0-8757-4d8385f9ca53]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:09 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Volume volume-1297b5a3-71ac-4fca-aa1c-e129b737131c (1297b5a3-71ac-4fca-aa1c-e129b737131c): created successfully Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7230a01d-b194-46dd-9e0e-4dd6d18fea9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Flow 'volume_create_manager' (179f1a43-8cd8-4628-a02e-e5ac59c66465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:09 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-12a30b9b-a3b1-48ee-848c-e32cb8de1805 tempest-VolumesTransfersV355Test-701099849 None] Created volume successfully. Apr 10 18:27:09 devstack sudo[85633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:09 devstack sudo[85633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:10 devstack sudo[85633]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.686s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:10 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f 1G Apr 10 18:27:10 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Acquiring lock "cinder-1297b5a3-71ac-4fca-aa1c-e129b737131c-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-1297b5a3-71ac-4fca-aa1c-e129b737131c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Acquiring lock "cinder-quobyte-1297b5a3-71ac-4fca-aa1c-e129b737131c" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-quobyte-1297b5a3-71ac-4fca-aa1c-e129b737131c" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfe2248-8ffa-4029-a883-73101363860f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:10 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c Apr 10 18:27:10 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:11 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f 1G" returned: 0 in 0.811s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5c6080-e122-4c00-b881-1c0a67e19636 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:11 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5c6080-e122-4c00-b881-1c0a67e19636 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f Apr 10 18:27:11 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:11 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c" returned: 0 in 0.762s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:11 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c Apr 10 18:27:11 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:11 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5c6080-e122-4c00-b881-1c0a67e19636 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f" returned: 0 in 0.484s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:11 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:11 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f Apr 10 18:27:11 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:11 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1297b5a3-71ac-4fca-aa1c-e129b737131c" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-quobyte-1297b5a3-71ac-4fca-aa1c-e129b737131c" released by "delete_volume" :: held 1.246s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Created reservations ['587c037e-9844-444a-83b3-4c6f9178849c', 'ba87e370-6f8a-4792-acfc-db502d2fdf6f', '0c24b225-8814-4737-be48-605929e18106', '3b1fb4f3-3aec-4965-880f-c8009bdd7891'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:11 devstack sudo[85674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:11 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:12 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f" returned: 0 in 0.544s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:12 devstack sudo[85677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info Apr 10 18:27:12 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:12 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Deleted volume successfully. Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d44cae74-1519-471e-aed8-fa7d8662c66b tempest-VolumesTransfersV355Test-1255539244 None] Lock "cinder-1297b5a3-71ac-4fca-aa1c-e129b737131c-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:12 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:12 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:12 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info Apr 10 18:27:12 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:13 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.info" returned: 0 in 0.602s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.689s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1588010402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ec0ad10-560d-40fa-9679-648e0fc1a047,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ea97e994f445fc924a33ec30bbe150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:09Z,use_quota=True,user_id='8de39d95238a42828c5b4b8f5ba0c23c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Creating volume 2ec0ad10-560d-40fa-9679-648e0fc1a047 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:13 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:13 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 1073741824 Apr 10 18:27:13 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:13 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1eac83c3-6fbe-4923-b039-9e9bee2a6d69 tempest-GroupSnapshotsTest-866023021 None] group_snapshot f074e4b9-32db-40ad-a843-d21b9ccef37a: created successfully Apr 10 18:27:14 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 1073741824" returned: 0 in 0.867s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:14 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 Apr 10 18:27:14 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:14 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa9a38f3-121d-4886-bc8a-113740dafa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ec0ad10-560d-40fa-9679-648e0fc1a047', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3f0586-283a-44d6-82de-34e59f1db34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Volume volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 (2ec0ad10-560d-40fa-9679-648e0fc1a047): created successfully Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae3f0586-283a-44d6-82de-34e59f1db34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Flow 'volume_create_manager' (1607b2a7-75de-456e-a1c4-3829f16bac34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:14 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-ceb2d46d-6d50-4be4-9505-73ec61e58e97 req-9caac725-bf68-4373-a509-040a630786ba tempest-VolumesGetTestJSON-1973708036 None] Created volume successfully. Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-59c96c0a-0796-4887-9865-da107a2cb18f-6dd3f209-602e-4bd1-aab6-579399cb6de4" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-59c96c0a-0796-4887-9865-da107a2cb18f-6dd3f209-602e-4bd1-aab6-579399cb6de4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Creating volume 6dd3f209-602e-4bd1-aab6-579399cb6de4 from snapshot 59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-6dd3f209-602e-4bd1-aab6-579399cb6de4" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-6dd3f209-602e-4bd1-aab6-579399cb6de4" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] snapshot: 59c96c0a-0796-4887-9865-da107a2cb18f, volume: 6dd3f209-602e-4bd1-aab6-579399cb6de4, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[869443c6-3ac3-49ac-b2bb-1455ef7b4dd4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:15 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f Apr 10 18:27:15 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:15 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f" returned: 0 in 0.584s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5c6080-e122-4c00-b881-1c0a67e19636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1068ad-e03a-4fab-88e0-290bea48661d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:15 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:15 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Acquiring lock "cinder-2ec0ad10-560d-40fa-9679-648e0fc1a047-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Lock "cinder-2ec0ad10-560d-40fa-9679-648e0fc1a047-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Acquiring lock "cinder-quobyte-2ec0ad10-560d-40fa-9679-648e0fc1a047" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Lock "cinder-quobyte-2ec0ad10-560d-40fa-9679-648e0fc1a047" acquired by "delete_volume" :: waited 0.018s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1716a778-d699-478c-8353-1cf2c855457b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:16 devstack sudo[85735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 Apr 10 18:27:16 devstack sudo[85735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:16 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.729s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:16 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 Apr 10 18:27:16 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:16 devstack sudo[85735]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:16 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047 Apr 10 18:27:16 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:16 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:16 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:17 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2ec0ad10-560d-40fa-9679-648e0fc1a047" returned: 0 in 0.520s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Lock "cinder-quobyte-2ec0ad10-560d-40fa-9679-648e0fc1a047" released by "delete_volume" :: held 1.100s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG cinder.quota [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Created reservations ['21490d6f-e009-4da2-8b86-63a45ec502e3', 'e556c259-3832-4dcf-bac7-c4d5ecb8f70a', '0256759b-5930-4032-af65-3a51fc9c4967', '99c70dfc-1188-40f6-b6d2-eefe1bd3906c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:17 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:17 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:17 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.125s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:19 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.665s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG cinder.manager [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Deleted volume successfully. Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-67a12069-939f-4494-96f3-4ecefeb3f3a7 req-0aa91d2d-6710-4f84-aa90-24b4818c1b76 tempest-VolumesGetTestJSON-1973708036 None] Lock "cinder-2ec0ad10-560d-40fa-9679-648e0fc1a047-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:19 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4" returned: 0 in 2.636s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb0f8be-f0b5-412f-a472-6407418251b6]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:19 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:19 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:19 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.776s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636, size 1024.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:27:19 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Converted 1024.00 MB image at 388.36 MB/s Apr 10 18:27:19 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:19 devstack sudo[85781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 Apr 10 18:27:19 devstack sudo[85781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:20 devstack sudo[85781]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4" returned: 0 in 0.667s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-6dd3f209-602e-4bd1-aab6-579399cb6de4" released by "_copy_volume_from_snapshot" :: held 5.456s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-59c96c0a-0796-4887-9865-da107a2cb18f-6dd3f209-602e-4bd1-aab6-579399cb6de4" released by "_create_volume_from_snapshot" :: held 5.477s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.496s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:20 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-cac2d0c0-80a8-4d38-a0d5-18190fbe367f tempest-GroupSnapshotsTest-866023021 None] Create group from source-snapshot-f074e4b9-32db-40ad-a843-d21b9ccef37a completed successfully. Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-6dd3f209-602e-4bd1-aab6-579399cb6de4" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-6dd3f209-602e-4bd1-aab6-579399cb6de4" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[07439d89-5a8f-4d70-8e23-9f500ab8f837]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:21 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 Apr 10 18:27:21 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Flow 'volume_create_manager' (b1edf070-5f8a-4bce-a5e3-c65a54160f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8759fdc7-1936-4d39-b331-9144c11d8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8759fdc7-1936-4d39-b331-9144c11d8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1873692646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5160898-df64-4e6f-9efe-0373d5bca879,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2dfe60af503e41e88ea8c12489975cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:22Z,use_quota=True,user_id='46d61801ddcd4b3daaac0b15bab4e894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776b02a4-a906-49d3-9ac3-00a5dd4c79c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776b02a4-a906-49d3-9ac3-00a5dd4c79c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a062d71-fdd7-4486-9e80-85bcb98c90db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a062d71-fdd7-4486-9e80-85bcb98c90db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5160898-df64-4e6f-9efe-0373d5bca879', 'volume_name': 'volume-b5160898-df64-4e6f-9efe-0373d5bca879', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f55303c-b91f-43d7-95b6-eaaa932a05c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f55303c-b91f-43d7-95b6-eaaa932a05c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8c11b7-6a8b-461d-9cb6-efebaa7be1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Volume b5160898-df64-4e6f-9efe-0373d5bca879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5160898-df64-4e6f-9efe-0373d5bca879', 'volume_size': 1} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1873692646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5160898-df64-4e6f-9efe-0373d5bca879,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2dfe60af503e41e88ea8c12489975cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:22Z,use_quota=True,user_id='46d61801ddcd4b3daaac0b15bab4e894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Creating volume b5160898-df64-4e6f-9efe-0373d5bca879 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:21 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:21 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 1073741824 Apr 10 18:27:21 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:22 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4" returned: 0 in 1.150s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:22 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4 Apr 10 18:27:22 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:22 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 1073741824" returned: 0 in 0.741s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:22 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 Apr 10 18:27:22 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:23 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd3f209-602e-4bd1-aab6-579399cb6de4" returned: 0 in 0.561s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-6dd3f209-602e-4bd1-aab6-579399cb6de4" released by "delete_volume" :: held 1.759s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['9a72e8d1-ba8f-4457-8b72-056e53935001'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:23 devstack cinder-volume[82020]: WARNING cinder.quota [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1890984285 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1890984285, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:23 devstack cinder-volume[82020]: WARNING cinder.quota [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1890984285 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1890984285, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['5b7b166c-8774-49e5-ad14-cc5a431714b5', '1cdfb045-8b6a-4224-a835-502c9319cdb6', '908763d5-f7de-479c-b919-8b248458af23', '3e77c9a2-15c2-4c91-99c2-8dc1bdd5557f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:23 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879" returned: 0 in 0.672s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8c11b7-6a8b-461d-9cb6-efebaa7be1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5160898-df64-4e6f-9efe-0373d5bca879', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19bfefc-3dc6-43d8-b99e-61ddc8899f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:23 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:23 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:23 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Volume volume-b5160898-df64-4e6f-9efe-0373d5bca879 (b5160898-df64-4e6f-9efe-0373d5bca879): created successfully Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19bfefc-3dc6-43d8-b99e-61ddc8899f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Flow 'volume_create_manager' (b1edf070-5f8a-4bce-a5e3-c65a54160f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e218b1d9-ac07-4101-b0bf-64203e5d82ee tempest-VolumesTestJSON-1991345570 None] Created volume successfully. Apr 10 18:27:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] group_snapshot f074e4b9-32db-40ad-a843-d21b9ccef37a: deleting Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] group_snapshot f074e4b9-32db-40ad-a843-d21b9ccef37a: deleting {{(pid=82020) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-5e5c6080-e122-4c00-b881-1c0a67e19636" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-5e5c6080-e122-4c00-b881-1c0a67e19636" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-59c96c0a-0796-4887-9865-da107a2cb18f" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-59c96c0a-0796-4887-9865-da107a2cb18f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Deleting offline snapshot 59c96c0a-0796-4887-9865-da107a2cb18f of volume 5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] snapshot_file for this snap is: volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ede1ce6-aec7-4076-8ec8-dd14e1564006]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:23 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f Apr 10 18:27:23 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:24 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.735s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:24 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8ec39c56-6065-47fd-ae82-30142e413651 tempest-GroupSnapshotsTest-866023021 None] Delete group completed successfully. Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Flow 'volume_create_manager' (2f54e2f2-510a-41ee-a1f4-b1426e956781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746592a8-c585-4004-9957-513a8d16ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746592a8-c585-4004-9957-513a8d16ae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-283215795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2dfe60af503e41e88ea8c12489975cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:24Z,use_quota=True,user_id='46d61801ddcd4b3daaac0b15bab4e894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b3f4dc-8edb-4557-9e5e-fe0fc9a60933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b3f4dc-8edb-4557-9e5e-fe0fc9a60933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e384ba-f873-495e-9ae3-3b387a790148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e384ba-f873-495e-9ae3-3b387a790148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b', 'volume_name': 'volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dacd6e-bd6e-4631-a1ea-716aaa465507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4dacd6e-bd6e-4631-a1ea-716aaa465507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9b3ad0-55c3-47c8-a4d5-9a9bc6d8d1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Volume 2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b', 'volume_size': 1} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-283215795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2dfe60af503e41e88ea8c12489975cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:24Z,use_quota=True,user_id='46d61801ddcd4b3daaac0b15bab4e894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Creating volume 2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:24 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:24 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b 1073741824 Apr 10 18:27:24 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:24 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f" returned: 0 in 0.847s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5c6080-e122-4c00-b881-1c0a67e19636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b126d089-504f-4bde-b475-69cac8b524d5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:24 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:24 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:25 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b 1073741824" returned: 0 in 0.763s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:25 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b Apr 10 18:27:25 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:25 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.861s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:25 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f Apr 10 18:27:25 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:25 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b" returned: 0 in 0.672s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9b3ad0-55c3-47c8-a4d5-9a9bc6d8d1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe261a3d-827b-4717-b4f9-eb85cb6b5217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:25 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Volume volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b (2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b): created successfully Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe261a3d-827b-4717-b4f9-eb85cb6b5217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Flow 'volume_create_manager' (2f54e2f2-510a-41ee-a1f4-b1426e956781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-75fd3162-60f8-4595-9e1e-a583197e7e2c tempest-VolumesTestJSON-1991345570 None] Created volume successfully. Apr 10 18:27:26 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f" returned: 0 in 0.780s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:26 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f Apr 10 18:27:26 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Flow 'volume_create_manager' (fab98314-d849-4b50-b09d-81814ba56e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e680b164-9926-4f0c-9406-ee5c71f3c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e680b164-9926-4f0c-9406-ee5c71f3c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-383317821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2dfe60af503e41e88ea8c12489975cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:27Z,use_quota=True,user_id='46d61801ddcd4b3daaac0b15bab4e894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a64c15e-9152-4c6f-a947-ac2cd9e3cad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a64c15e-9152-4c6f-a947-ac2cd9e3cad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f4b0a3-681c-4b7a-b159-db33527e566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f4b0a3-681c-4b7a-b159-db33527e566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f', 'volume_name': 'volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362761da-4202-442e-98cd-0c0904811dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362761da-4202-442e-98cd-0c0904811dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcfffb1-864a-47b0-bea8-d62e28719813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:27 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Volume a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f', 'volume_size': 1} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-383317821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2dfe60af503e41e88ea8c12489975cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:27Z,use_quota=True,user_id='46d61801ddcd4b3daaac0b15bab4e894',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Creating volume a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:27 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:27 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f 1073741824 Apr 10 18:27:27 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:27 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636.59c96c0a-0796-4887-9865-da107a2cb18f" returned: 0 in 1.137s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-59c96c0a-0796-4887-9865-da107a2cb18f" released by "_delete_snapshot" :: held 3.745s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-5e5c6080-e122-4c00-b881-1c0a67e19636" released by "delete_snapshot" :: held 3.775s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:27 devstack cinder-volume[82020]: WARNING cinder.quota [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1890984285 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1890984285, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] Created reservations ['b29d5ac0-2b09-4c10-8bda-9faa789e1fd0', '24ee02ee-381c-4c1c-89ef-035c87f0b7cb', '23589d83-f0b7-47e3-a271-6a3fd9149d83', 'e8577c33-095a-4afe-93fd-941d4483aa9a'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:27 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c9e4eeb6-477c-4033-9a68-17653d5edb8e tempest-GroupSnapshotsTest-866023021 None] group_snapshot f074e4b9-32db-40ad-a843-d21b9ccef37a: deleted successfully Apr 10 18:27:27 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f 1073741824" returned: 0 in 0.693s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:28 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f Apr 10 18:27:28 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-5e5c6080-e122-4c00-b881-1c0a67e19636" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-5e5c6080-e122-4c00-b881-1c0a67e19636" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09bcb0d-58eb-4bbc-b6cc-d9023441db94]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:28 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:28 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:28 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f" returned: 0 in 0.561s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcfffb1-864a-47b0-bea8-d62e28719813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02894d40-de4f-49f2-b317-0293fedbb68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:28 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Volume volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f (a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f): created successfully Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02894d40-de4f-49f2-b317-0293fedbb68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Flow 'volume_create_manager' (fab98314-d849-4b50-b09d-81814ba56e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-902d7ced-c547-4a17-9918-c0df92aa92bb tempest-VolumesTestJSON-1991345570 None] Created volume successfully. Apr 10 18:27:28 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.612s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:28 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636 Apr 10 18:27:28 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:29 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e5c6080-e122-4c00-b881-1c0a67e19636" returned: 0 in 0.591s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-5e5c6080-e122-4c00-b881-1c0a67e19636" released by "delete_volume" :: held 1.245s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['10236fa9-2caa-4afb-b31b-a994846df926'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:29 devstack cinder-volume[82020]: WARNING cinder.db.sqlalchemy.api [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1890984285'] Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['d3764872-dd9d-4838-8a39-1523767ed39a', '42089150-35c8-4fb7-beaa-9aabe64edc5b', 'feefea93-ad0f-4b5a-a99a-eb149f69b798', 'ed067b9a-c475-429a-810f-5be279b4a591'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:29 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:29 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Flow 'volume_create_manager' (d7fb23fd-0ea2-45e2-b265-011ea78f67cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5495fd-3d17-4114-9072-dfe5fd3b63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "cinder-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5495fd-3d17-4114-9072-dfe5fd3b63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819335546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fdb31e-4af5-46f0-bd8c-794acc9da1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310b4ca5a75e428484022b350065a065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:30Z,use_quota=True,user_id='4f6a477d70a54af89200ee718dca9f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2db871-0866-4b42-b0ba-ebd60f084497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2db871-0866-4b42-b0ba-ebd60f084497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:29 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792227ab-11cb-4595-9068-a236a13b925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792227ab-11cb-4595-9068-a236a13b925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fdb31e-4af5-46f0-bd8c-794acc9da1ce', 'volume_name': 'volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddd75a5-8743-4cda-a4df-87a6c6d80f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddd75a5-8743-4cda-a4df-87a6c6d80f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba75fd3-bcc7-4fab-8593-0304a1b2f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:30 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Volume d1fdb31e-4af5-46f0-bd8c-794acc9da1ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce', 'volume_size': 1} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819335546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fdb31e-4af5-46f0-bd8c-794acc9da1ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310b4ca5a75e428484022b350065a065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:30Z,use_quota=True,user_id='4f6a477d70a54af89200ee718dca9f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Creating volume d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:30 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:30 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce 1073741824 Apr 10 18:27:30 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "cinder-quobyte-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-quobyte-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[12504501-0212-4189-a4a8-142099104a81]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:30 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f Apr 10 18:27:30 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:30 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.537s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-025cc614-0da6-4a7e-a486-1714593589c6 tempest-GroupSnapshotsTest-866023021 None] Delete group completed successfully. Apr 10 18:27:30 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce 1073741824" returned: 0 in 0.573s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:30 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:27:30 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:30 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f" returned: 0 in 0.590s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:30 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f Apr 10 18:27:30 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8c0eb90f-fc59-4868-ba4a-c4a628bdfd71 tempest-GroupSnapshotsTest-866023021 None] Group tempest-GroupSnapshotsTest-Group-497939372: creating Apr 10 18:27:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8c0eb90f-fc59-4868-ba4a-c4a628bdfd71 tempest-GroupSnapshotsTest-866023021 None] Group tempest-GroupSnapshotsTest-Group-497939372: created successfully Apr 10 18:27:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8c0eb90f-fc59-4868-ba4a-c4a628bdfd71 tempest-GroupSnapshotsTest-866023021 None] Create group completed successfully. Apr 10 18:27:31 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba75fd3-bcc7-4fab-8593-0304a1b2f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1affb4-d2a0-4476-964a-6c7235afc7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:31 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Volume volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce (d1fdb31e-4af5-46f0-bd8c-794acc9da1ce): created successfully Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1affb4-d2a0-4476-964a-6c7235afc7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Flow 'volume_create_manager' (d7fb23fd-0ea2-45e2-b265-011ea78f67cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-421b7faa-8c1c-4aeb-8619-c9b963475fcf tempest-VolumesActionsTest-1453102242 None] Created volume successfully. Apr 10 18:27:31 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f" returned: 0 in 0.458s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-quobyte-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f" released by "delete_volume" :: held 1.095s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-30274b8b-0c99-419e-8c47-63a202970073 req-4dc7fd2e-a775-46d3-ab1c-4968e2050960 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Terminate volume connection completed successfully. Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-30274b8b-0c99-419e-8c47-63a202970073 req-4dc7fd2e-a775-46d3-ab1c-4968e2050960 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Deleting attachment 8ec73d71-bc50-4513-96a2-a782cd3ec09b. {{(pid=82020) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Created reservations ['51261be7-9ed3-4fa2-ac8a-421474a7905f', '66ffaee6-11b0-49b5-a5ad-51f047c29562', '4aef711a-07fc-4f40-9df5-7cf4b776ebc9', 'b6ef7220-1dc0-471f-a424-9b1bf6df4ed6'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:31 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:31 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:31 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.406s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Deleted volume successfully. Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6cec34c9-7bac-45a6-992f-4cd27303dc83 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-a61bf5b2-97a5-4d7e-8da2-98f4fc66d74f-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "cinder-f0dba5d2-1d7f-40c1-95bf-2fea34bca216-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-f0dba5d2-1d7f-40c1-95bf-2fea34bca216-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "cinder-quobyte-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-quobyte-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea7c9cd-57fb-4044-960d-587ef696296b]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:31 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:27:31 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "cinder-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "cinder-quobyte-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-quobyte-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b" acquired by "delete_volume" :: waited 0.024s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a3b34-e4ee-4ea5-8627-75d1a2a2e6ff]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (e5c26060-56ce-465f-8db0-421f68037a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:32 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b Apr 10 18:27:32 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd139a7-ebdf-4ac3-a94a-45471aa938c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd139a7-ebdf-4ac3-a94a-45471aa938c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872845536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109aa6-1665-4d8d-b9b2-888e4fb71066,host='devstack@QuobyteHD#QuobyteHD',id=acd4f948-450f-4c9a-87e8-00cc6ad9b818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:32Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb7144f7-68c1-4530-884d-1d98324c3b22),volume_type_id=cb7144f7-68c1-4530-884d-1d98324c3b22)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864ab09a-5173-4684-ba0d-5e201cfa5fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864ab09a-5173-4684-ba0d-5e201cfa5fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab6041b-76cf-47fd-b65e-2ae43459425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab6041b-76cf-47fd-b65e-2ae43459425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd4f948-450f-4c9a-87e8-00cc6ad9b818', 'volume_name': 'volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42184085-bfe9-406f-80ae-d1d4bb29bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42184085-bfe9-406f-80ae-d1d4bb29bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e86be64-af9b-42b9-8b6d-014857a7fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:32 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Volume acd4f948-450f-4c9a-87e8-00cc6ad9b818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818', 'volume_size': 1} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1109aa6-1665-4d8d-b9b2-888e4fb71066,created_at=2026-04-10T16:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872845536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109aa6-1665-4d8d-b9b2-888e4fb71066,host='devstack@QuobyteHD#QuobyteHD',id=acd4f948-450f-4c9a-87e8-00cc6ad9b818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:32Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb7144f7-68c1-4530-884d-1d98324c3b22),volume_type_id=cb7144f7-68c1-4530-884d-1d98324c3b22)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Creating volume acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:32 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:32 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 1073741824 Apr 10 18:27:32 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:32 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 0 in 0.712s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:32 devstack sudo[85990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:27:32 devstack sudo[85990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:32 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b" returned: 0 in 0.620s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:32 devstack sudo[85996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b Apr 10 18:27:32 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:33 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 1073741824" returned: 0 in 0.637s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:33 devstack sudo[86004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 Apr 10 18:27:33 devstack sudo[86004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:33 devstack sudo[85990]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 1 in 0.529s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:33 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216 Apr 10 18:27:33 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:33 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-quobyte-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b" released by "delete_volume" :: held 1.180s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Created reservations ['a8db2b40-cdec-4e09-9986-9566589bea65', 'ee11995c-218d-464f-b743-94825d37de00', '0c201c9d-4733-4ced-a0e9-c37235bf055d', '450f1a26-a49b-4996-ba4a-73ca525e07b6'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:33 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:33 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:33 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" returned: 0 in 0.480s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:33 devstack sudo[86004]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-quobyte-f0dba5d2-1d7f-40c1-95bf-2fea34bca216" released by "delete_volume" :: held 1.769s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818" returned: 0 in 0.559s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e86be64-af9b-42b9-8b6d-014857a7fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fac073-09f5-4325-89f8-e00404043ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:33 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Volume volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 (acd4f948-450f-4c9a-87e8-00cc6ad9b818): created successfully Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fac073-09f5-4325-89f8-e00404043ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (e5c26060-56ce-465f-8db0-421f68037a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-80ed6a70-bc8e-4b1a-9444-8dbac64bf7bc tempest-GroupSnapshotsTest-866023021 None] Created volume successfully. Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.quota [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Created reservations ['cddddacd-625b-409a-8c7d-1c998a1b32f7', 'af1e7a49-0fda-4050-969a-0618e8be5621', 'e09041aa-926a-4296-95f6-a1fcebb39cbc', '31224887-049e-4118-a89a-63d606898d67'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:33 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:33 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:33 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.445s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Deleted volume successfully. Apr 10 18:27:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f2db4a0-d2a4-4c5d-9508-2e8b14d8d668 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-2c4e0ff1-07ba-4a0c-a1f6-ac78a3bac85b-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:34 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.448s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.manager [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:34 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Deleted volume successfully. Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-30274b8b-0c99-419e-8c47-63a202970073 req-bef0e23f-cc3f-4007-a8e9-7d92c76fa0c5 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-f0dba5d2-1d7f-40c1-95bf-2fea34bca216-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "cinder-b5160898-df64-4e6f-9efe-0373d5bca879-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-b5160898-df64-4e6f-9efe-0373d5bca879-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "cinder-quobyte-b5160898-df64-4e6f-9efe-0373d5bca879" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-quobyte-b5160898-df64-4e6f-9efe-0373d5bca879" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fe9c36-4554-4dc8-8b20-b4632c6f9329]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:34 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 Apr 10 18:27:34 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (f31b8a42-4f20-4ae1-ae0f-4e74591b5463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1908dd23-955b-40ad-9e13-2e04dbe556de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1908dd23-955b-40ad-9e13-2e04dbe556de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067805569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109aa6-1665-4d8d-b9b2-888e4fb71066,host='devstack@QuobyteHD#QuobyteHD',id=95ef6e04-a531-4280-8590-597acd0ecb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:35Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb7144f7-68c1-4530-884d-1d98324c3b22),volume_type_id=cb7144f7-68c1-4530-884d-1d98324c3b22)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3921564f-b050-4964-ba32-0335e571d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3921564f-b050-4964-ba32-0335e571d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9480e84-8c01-483a-b42b-6b44864c9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9480e84-8c01-483a-b42b-6b44864c9acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ef6e04-a531-4280-8590-597acd0ecb40', 'volume_name': 'volume-95ef6e04-a531-4280-8590-597acd0ecb40', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6b113d-0172-4822-82ec-a41bb6f0b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6b113d-0172-4822-82ec-a41bb6f0b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb5d176-a237-46ef-ac24-03e743023a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:34 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Volume 95ef6e04-a531-4280-8590-597acd0ecb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ef6e04-a531-4280-8590-597acd0ecb40', 'volume_size': 1} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1109aa6-1665-4d8d-b9b2-888e4fb71066,created_at=2026-04-10T16:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2067805569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1109aa6-1665-4d8d-b9b2-888e4fb71066,host='devstack@QuobyteHD#QuobyteHD',id=95ef6e04-a531-4280-8590-597acd0ecb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:35Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb7144f7-68c1-4530-884d-1d98324c3b22),volume_type_id=cb7144f7-68c1-4530-884d-1d98324c3b22)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Creating volume 95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:34 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:34 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 1073741824 Apr 10 18:27:34 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:34 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879" returned: 0 in 0.577s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:34 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879 Apr 10 18:27:34 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:35 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 1073741824" returned: 0 in 0.630s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:35 devstack sudo[86032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 Apr 10 18:27:35 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:35 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b5160898-df64-4e6f-9efe-0373d5bca879" returned: 0 in 0.534s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-quobyte-b5160898-df64-4e6f-9efe-0373d5bca879" released by "delete_volume" :: held 1.142s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Created reservations ['ef8042ea-e9f4-4f57-9117-16bb5d94d6cf', '24f69641-7ebf-4d8c-8a58-f71723f225d1', 'd85ef18a-7496-4097-955f-a443fc067648', '03f25f8e-ff77-4db3-90b6-716163846d8b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:35 devstack sudo[86034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:35 devstack sudo[86034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:35 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40" returned: 0 in 0.466s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb5d176-a237-46ef-ac24-03e743023a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ef6e04-a531-4280-8590-597acd0ecb40', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba8b492-bd9e-4ddb-9bbe-9fa79b8ca6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:35 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Volume volume-95ef6e04-a531-4280-8590-597acd0ecb40 (95ef6e04-a531-4280-8590-597acd0ecb40): created successfully Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba8b492-bd9e-4ddb-9bbe-9fa79b8ca6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (f31b8a42-4f20-4ae1-ae0f-4e74591b5463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7bd335cd-025f-437c-a081-da5db069a4c6 tempest-GroupSnapshotsTest-866023021 None] Created volume successfully. Apr 10 18:27:36 devstack sudo[86034]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:36 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Deleted volume successfully. Apr 10 18:27:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-21e6b07c-39a2-47ab-9a66-3d9cc1ee4d28 tempest-VolumesTestJSON-1991345570 None] Lock "cinder-b5160898-df64-4e6f-9efe-0373d5bca879-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-27745895-aa12-470d-ab12-803313921c4e tempest-GroupSnapshotsTest-866023021 None] Update group completed successfully. Apr 10 18:27:38 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6a37a848-b082-47ca-a20f-fbf44294d080 tempest-GroupSnapshotsTest-866023021 None] Update group completed successfully. Apr 10 18:27:39 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9d92c71d-1f48-4b25-b2d3-7a46530a77b4 tempest-GroupSnapshotsTest-866023021 None] Update group completed successfully. Apr 10 18:27:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-db164ef9-33cc-43a1-852c-0055cadbebbb tempest-BackendsCapabilitiesAdminTestsJSON-683128381 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82020) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 18:27:40 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7aa3a026-8600-40c2-9e76-58d8c80dffcf tempest-GroupSnapshotsTest-866023021 None] Update group completed successfully. Apr 10 18:27:40 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-86263b6b-3692-4a35-8419-ecae2af90d1a tempest-BackendsCapabilitiesAdminTestsJSON-683128381 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82020) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 18:27:41 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] GroupSnapshot 972785b9-a8a3-4b86-acf3-c859808dcbec: creating. Apr 10 18:27:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Group snapshot 972785b9-a8a3-4b86-acf3-c859808dcbec: creating. {{(pid=82020) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 18:27:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:41 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Creating offline snapshot 73cb59f8-ae43-4873-ac8e-17ef877c5519 of volume acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:27:41 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee926fae-c221-4c67-97bf-7c5bc8ab90d0]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:41 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 Apr 10 18:27:41 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:42 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818" returned: 0 in 0.568s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:42 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 1G Apr 10 18:27:42 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:43 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 1G" returned: 0 in 1.046s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:43 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 Apr 10 18:27:43 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:44 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519" returned: 0 in 0.894s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:44 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:44 devstack sudo[86193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 Apr 10 18:27:44 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:44 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519" returned: 0 in 0.619s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:INSERT=40,cinder:UPDATE=160,cinder:SELECT=140,cinder:DELETE=12 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=149,cinder:UPDATE=181,cinder:INSERT=48,cinder:DELETE=12 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:44 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info Apr 10 18:27:44 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902a30cb-d72f-44a3-9b64-032d05128a57 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" by "attach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902a30cb-d72f-44a3-9b64-032d05128a57 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" acquired by "attach_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-902a30cb-d72f-44a3-9b64-032d05128a57 tempest-VolumesActionsTest-1453102242 None] Attaching volume d1fdb31e-4af5-46f0-bd8c-794acc9da1ce to instance 6c0ed50c-bd02-4f91-a050-ebc15083ab5d at mountpoint /dev/vdb on host None. Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-902a30cb-d72f-44a3-9b64-032d05128a57 tempest-VolumesActionsTest-1453102242 None] Attach volume completed successfully. Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902a30cb-d72f-44a3-9b64-032d05128a57 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" released by "attach_volume" :: held 0.078s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d78b5516-e0ad-4092-92fb-ed38c89f1784 tempest-GroupSnapshotsV319Test-1241352363 None] Group tempest-GroupSnapshotsV319Test-Group-2025732071: creating Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d78b5516-e0ad-4092-92fb-ed38c89f1784 tempest-GroupSnapshotsV319Test-1241352363 None] Group tempest-GroupSnapshotsV319Test-Group-2025732071: created successfully Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d78b5516-e0ad-4092-92fb-ed38c89f1784 tempest-GroupSnapshotsV319Test-1241352363 None] Create group completed successfully. Apr 10 18:27:45 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info" returned: 0 in 0.508s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:45 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:45 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info Apr 10 18:27:45 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-081ce1df-149b-4eb7-8878-bf6135917359 req-724d1093-e009-400f-884a-6bb4ae3a7629 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Terminate volume connection completed successfully. Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-081ce1df-149b-4eb7-8878-bf6135917359 req-724d1093-e009-400f-884a-6bb4ae3a7629 tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Deleting attachment 8196c224-9332-482c-ae25-6e621024984c. {{(pid=82020) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fd1e918-8b08-4a94-b031-327a4ba7b452 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-detach_volume" by "detach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fd1e918-8b08-4a94-b031-327a4ba7b452 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1fd1e918-8b08-4a94-b031-327a4ba7b452 tempest-VolumesActionsTest-1453102242 None] Detaching volume d1fdb31e-4af5-46f0-bd8c-794acc9da1ce from instance 6c0ed50c-bd02-4f91-a050-ebc15083ab5d. Apr 10 18:27:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1fd1e918-8b08-4a94-b031-327a4ba7b452 tempest-VolumesActionsTest-1453102242 None] Detach volume completed successfully. Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fd1e918-8b08-4a94-b031-327a4ba7b452 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:45 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.info" returned: 0 in 0.452s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.149s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Creating offline snapshot fe9561f2-35b6-46a3-b6bf-8b3470f56d2c of volume 95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b7a1e-265e-4b87-9c74-99f80c6be7df]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:45 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 Apr 10 18:27:45 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "cinder-682d32a0-5a7d-4102-85f8-1502b5782269-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-682d32a0-5a7d-4102-85f8-1502b5782269-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "cinder-quobyte-682d32a0-5a7d-4102-85f8-1502b5782269" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-quobyte-682d32a0-5a7d-4102-85f8-1502b5782269" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62ac677-1752-4cf1-b8de-25117c959a43]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:46 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 Apr 10 18:27:46 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:46 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40" returned: 0 in 0.666s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:46 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c 1G Apr 10 18:27:46 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:46 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269" returned: 0 in 0.659s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:27:46 devstack sudo[86218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269 Apr 10 18:27:46 devstack sudo[86218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Flow 'volume_create_manager' (c11fd090-8405-4e5e-ae02-bcbb827d1e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f57095e-e809-4819-aa7e-0795494fe869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f57095e-e809-4819-aa7e-0795494fe869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587633102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=803e678e-3896-4df4-a4d1-87e413380afa,host='devstack@QuobyteHD#QuobyteHD',id=0a590a50-f64c-4f64-9e6b-74861fd60910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da570c357ec34b04b18cfaa974709e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:47Z,use_quota=True,user_id='5e741af7c89e4a868b27e6c658fec95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83a5c199-380b-4ff0-8e08-e15b28fa5d16),volume_type_id=83a5c199-380b-4ff0-8e08-e15b28fa5d16)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64388177-67f8-4f50-9e59-e92d13efafed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64388177-67f8-4f50-9e59-e92d13efafed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42edf31e-1557-4008-b98b-823d0281171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42edf31e-1557-4008-b98b-823d0281171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a590a50-f64c-4f64-9e6b-74861fd60910', 'volume_name': 'volume-0a590a50-f64c-4f64-9e6b-74861fd60910', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f8543c-f94c-4642-82eb-cdeb2f80b679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f8543c-f94c-4642-82eb-cdeb2f80b679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971b37e9-f19b-4de5-b0cd-d8db85840ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:46 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Volume 0a590a50-f64c-4f64-9e6b-74861fd60910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a590a50-f64c-4f64-9e6b-74861fd60910', 'volume_size': 1} Apr 10 18:27:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:47 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c 1G" returned: 0 in 0.636s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95ef6e04-a531-4280-8590-597acd0ecb40 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:47 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95ef6e04-a531-4280-8590-597acd0ecb40 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c Apr 10 18:27:47 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:47 devstack sudo[86218]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-682d32a0-5a7d-4102-85f8-1502b5782269" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-quobyte-682d32a0-5a7d-4102-85f8-1502b5782269" released by "delete_volume" :: held 1.219s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG cinder.quota [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Created reservations ['16275474-5093-4692-b0dc-8bc00652524c', '57c5feff-1802-4d73-81a3-f95392b7078a', '3d7c95c3-4b97-4a45-8402-5bdfed151ab8', '368651db-bd8c-43ba-b084-08c879d9e784'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:47 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:47 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:47 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95ef6e04-a531-4280-8590-597acd0ecb40 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" returned: 0 in 0.545s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:47 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:47 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c Apr 10 18:27:47 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:47 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG cinder.manager [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:47 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Deleted volume successfully. Apr 10 18:27:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-081ce1df-149b-4eb7-8878-bf6135917359 req-6104eb7a-78e3-4b96-831a-19ba32e0fe7c tempest-ServerBootFromVolumeStableRescueTest-291749077 None] Lock "cinder-682d32a0-5a7d-4102-85f8-1502b5782269-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:48 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" returned: 0 in 0.447s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:48 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info Apr 10 18:27:48 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:48 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info" returned: 0 in 0.421s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:48 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:48 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info Apr 10 18:27:48 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:49 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.info" returned: 0 in 0.486s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.252s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=803e678e-3896-4df4-a4d1-87e413380afa,created_at=2026-04-10T16:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587633102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=803e678e-3896-4df4-a4d1-87e413380afa,host='devstack@QuobyteHD#QuobyteHD',id=0a590a50-f64c-4f64-9e6b-74861fd60910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da570c357ec34b04b18cfaa974709e7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:27:47Z,use_quota=True,user_id='5e741af7c89e4a868b27e6c658fec95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83a5c199-380b-4ff0-8e08-e15b28fa5d16),volume_type_id=83a5c199-380b-4ff0-8e08-e15b28fa5d16)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Creating volume 0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:27:49 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:49 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 1073741824 Apr 10 18:27:49 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:49 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-13241205-d277-46ab-92a2-3b9f4007552a tempest-GroupSnapshotsTest-866023021 None] group_snapshot 972785b9-a8a3-4b86-acf3-c859808dcbec: created successfully Apr 10 18:27:49 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 1073741824" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:49 devstack sudo[86273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 Apr 10 18:27:49 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:50 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910" returned: 0 in 0.419s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971b37e9-f19b-4de5-b0cd-d8db85840ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a590a50-f64c-4f64-9e6b-74861fd60910', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ad17d1-883a-46db-a6c3-9bf716b9c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:27:50 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Volume volume-0a590a50-f64c-4f64-9e6b-74861fd60910 (0a590a50-f64c-4f64-9e6b-74861fd60910): created successfully Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ad17d1-883a-46db-a6c3-9bf716b9c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Flow 'volume_create_manager' (c11fd090-8405-4e5e-ae02-bcbb827d1e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:27:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-17f5fb15-3621-4ac0-9a2f-010f7139f75b tempest-GroupSnapshotsV319Test-1241352363 None] Created volume successfully. Apr 10 18:27:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] group_snapshot 972785b9-a8a3-4b86-acf3-c859808dcbec: deleting Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] group_snapshot 972785b9-a8a3-4b86-acf3-c859808dcbec: deleting {{(pid=82020) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-acd4f948-450f-4c9a-87e8-00cc6ad9b818" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-acd4f948-450f-4c9a-87e8-00cc6ad9b818" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-73cb59f8-ae43-4873-ac8e-17ef877c5519" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-73cb59f8-ae43-4873-ac8e-17ef877c5519" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Deleting offline snapshot 73cb59f8-ae43-4873-ac8e-17ef877c5519 of volume acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] snapshot_file for this snap is: volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f8fa0c-808d-49a4-87f1-7412920cf7b6]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:50 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 Apr 10 18:27:50 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:50 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519" returned: 0 in 0.582s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb909633-71ab-416d-8120-7a0537c78401]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:50 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 Apr 10 18:27:50 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:51 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] GroupSnapshot e2167d25-ca1b-40ff-852d-8097e43fc260: creating. Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Group snapshot e2167d25-ca1b-40ff-852d-8097e43fc260: creating. {{(pid=82020) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Creating offline snapshot b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c of volume 0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e322de90-7571-4943-9655-b50611ad3205]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:51 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 Apr 10 18:27:51 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:51 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818" returned: 0 in 0.506s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:51 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 Apr 10 18:27:51 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:51 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910" returned: 0 in 0.518s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:51 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c 1G Apr 10 18:27:51 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:51 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:51 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519 Apr 10 18:27:51 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:52 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818.73cb59f8-ae43-4873-ac8e-17ef877c5519" returned: 0 in 0.477s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-73cb59f8-ae43-4873-ac8e-17ef877c5519" released by "_delete_snapshot" :: held 2.095s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-acd4f948-450f-4c9a-87e8-00cc6ad9b818" released by "delete_snapshot" :: held 2.107s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-95ef6e04-a531-4280-8590-597acd0ecb40" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-95ef6e04-a531-4280-8590-597acd0ecb40" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Deleting offline snapshot fe9561f2-35b6-46a3-b6bf-8b3470f56d2c of volume 95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] snapshot_file for this snap is: volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd5f07a-402d-4614-b591-7988886465e1]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:52 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c 1G" returned: 0 in 0.615s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a590a50-f64c-4f64-9e6b-74861fd60910 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:52 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a590a50-f64c-4f64-9e6b-74861fd60910 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c Apr 10 18:27:52 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:52 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c Apr 10 18:27:52 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:52 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a590a50-f64c-4f64-9e6b-74861fd60910 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" returned: 0 in 0.547s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:52 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:53 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c Apr 10 18:27:53 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:53 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" returned: 0 in 0.583s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95ef6e04-a531-4280-8590-597acd0ecb40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c95b899-07f5-4827-adad-735804a112cc]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:53 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 Apr 10 18:27:53 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:53 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" returned: 0 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:53 devstack sudo[86353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info Apr 10 18:27:53 devstack sudo[86353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:53 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40" returned: 0 in 0.553s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:53 devstack sudo[86356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c Apr 10 18:27:53 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:53 devstack sudo[86353]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info" returned: 0 in 0.427s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:53 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:27:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:53 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info Apr 10 18:27:53 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:54 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:54 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c Apr 10 18:27:54 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:54 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.info" returned: 0 in 0.429s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.066s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1e0f67ce-524a-40ed-928b-70b8b77492ab tempest-GroupSnapshotsV319Test-1241352363 None] group_snapshot e2167d25-ca1b-40ff-852d-8097e43fc260: created successfully Apr 10 18:27:54 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40.fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-fe9561f2-35b6-46a3-b6bf-8b3470f56d2c" released by "_delete_snapshot" :: held 2.123s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-95ef6e04-a531-4280-8590-597acd0ecb40" released by "delete_snapshot" :: held 2.137s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:54 devstack cinder-volume[82020]: WARNING cinder.quota [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1594348142 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1594348142, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:54 devstack cinder-volume[82020]: WARNING cinder.quota [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1594348142 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1594348142, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Created reservations ['74a88d7f-ab94-475d-8023-49dc3a71b2d6', '58605019-9d6e-4fea-aa0f-8f8fde78543a', 'abe8ed36-fbc2-4e2a-9ece-e852de866293', 'a565b462-2661-463f-a9c6-081c482a2011'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:54 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] Created reservations ['52a02635-6b57-4f7b-bdb2-c8ea862677a0', 'b73bb76f-3dda-46d7-bc89-d425f5af37a9', 'acb6e92b-501d-4ea5-9e27-ed7d5a46dabd', 'cf06bf0b-2172-4d57-b8db-4b1558af296b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5fa8e6fc-e960-4d3c-b612-34e6f63e6f4e tempest-GroupSnapshotsTest-866023021 None] group_snapshot 972785b9-a8a3-4b86-acf3-c859808dcbec: deleted successfully Apr 10 18:27:55 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] group_snapshot e2167d25-ca1b-40ff-852d-8097e43fc260: deleting Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] group_snapshot e2167d25-ca1b-40ff-852d-8097e43fc260: deleting {{(pid=82020) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "cinder-quobyte-0a590a50-f64c-4f64-9e6b-74861fd60910" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "cinder-quobyte-0a590a50-f64c-4f64-9e6b-74861fd60910" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "cinder-quobyte-b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "cinder-quobyte-b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Deleting offline snapshot b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c of volume 0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] snapshot_file for this snap is: volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8727789-4eeb-4847-a3ab-a2846e0d5fc7]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-95ef6e04-a531-4280-8590-597acd0ecb40" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-95ef6e04-a531-4280-8590-597acd0ecb40" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcf2644-d007-4cc7-964c-4fac87a61dc4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:55 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c Apr 10 18:27:55 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:55 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 Apr 10 18:27:55 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:56 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" returned: 0 in 0.610s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a590a50-f64c-4f64-9e6b-74861fd60910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[feed51f5-6807-44bb-8479-24753e599fa6]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:56 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40" returned: 0 in 0.556s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:56 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40 Apr 10 18:27:56 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:56 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 Apr 10 18:27:56 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:56 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-95ef6e04-a531-4280-8590-597acd0ecb40" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:56 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-95ef6e04-a531-4280-8590-597acd0ecb40" released by "delete_volume" :: held 1.094s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-acd4f948-450f-4c9a-87e8-00cc6ad9b818" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-acd4f948-450f-4c9a-87e8-00cc6ad9b818" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:56 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c Apr 10 18:27:56 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41dffd5-01b8-430b-9c1d-bbaf391f9a5d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:57 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 Apr 10 18:27:57 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:57 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" returned: 0 in 0.576s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:57 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c Apr 10 18:27:57 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:57 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818" returned: 0 in 0.576s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:57 devstack sudo[86399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818 Apr 10 18:27:57 devstack sudo[86399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:58 devstack sudo[86399]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-acd4f948-450f-4c9a-87e8-00cc6ad9b818" returned: 0 in 0.449s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-acd4f948-450f-4c9a-87e8-00cc6ad9b818" released by "delete_volume" :: held 1.057s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['645a7552-6342-47d6-8bcb-e6d69539b961'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:58 devstack cinder-volume[82020]: WARNING cinder.quota [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1594348142 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1594348142, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['d172860b-51a8-402f-ac0c-4b874d4a3c9f', '885a7e35-499e-4585-8dbf-666ec2e9def8', '936e2cca-f6e5-4055-bc4f-d63f0429e727', 'cf9986e7-d8e6-4e88-a108-5b338d346b50'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:58 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910.b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" returned: 0 in 0.658s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "cinder-quobyte-b7f9c10a-05d6-4d7c-b5e9-3b11a5225b9c" released by "_delete_snapshot" :: held 2.443s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "cinder-quobyte-0a590a50-f64c-4f64-9e6b-74861fd60910" released by "delete_snapshot" :: held 2.473s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['e3676949-1062-4713-8661-0e2174c93ee5', 'ae863657-7470-429f-95c0-56f191e27c0b', '6da4e366-9ae8-4b87-923a-f7a80725e554', '24829820-ced4-4974-bac2-aeb6d38cbd00'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:58 devstack cinder-volume[82020]: WARNING cinder.quota [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-567683423 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-567683423, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:58 devstack cinder-volume[82020]: WARNING cinder.quota [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-567683423 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-567683423, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] Created reservations ['50c5c457-e0a0-44f9-9376-9bcc78c50c78', '9f60dfd9-eca7-486c-8fbb-8b95d2a40e19', '6f24fb22-c30d-4e56-8add-4dc8f55ef5df', '41d92484-9f7f-4f1a-b9f8-de3de321d200'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:58 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:27:58 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0c81e553-08f3-4272-85a2-c0c1ff1a3367 tempest-GroupSnapshotsV319Test-1241352363 None] group_snapshot e2167d25-ca1b-40ff-852d-8097e43fc260: deleted successfully Apr 10 18:27:58 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.567s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:58 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:27:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3fd36c4f-a633-45ba-af61-c124874e7b69 tempest-GroupSnapshotsTest-866023021 None] Delete group completed successfully. Apr 10 18:27:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "cinder-quobyte-0a590a50-f64c-4f64-9e6b-74861fd60910" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:27:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "cinder-quobyte-0a590a50-f64c-4f64-9e6b-74861fd60910" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:27:59 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb304b6-9197-4286-9742-19dc4ebba061]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:27:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:59 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 Apr 10 18:27:59 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:27:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1575650d-daaa-4691-aa75-99a105a92aa1 tempest-GroupSnapshotsTest-866023021 None] Group tempest-GroupSnapshotsTest-Group-1884120118: creating Apr 10 18:27:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1575650d-daaa-4691-aa75-99a105a92aa1 tempest-GroupSnapshotsTest-866023021 None] Group tempest-GroupSnapshotsTest-Group-1884120118: created successfully Apr 10 18:27:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1575650d-daaa-4691-aa75-99a105a92aa1 tempest-GroupSnapshotsTest-866023021 None] Create group completed successfully. Apr 10 18:27:59 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Apr 10 18:27:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910" returned: 0 in 0.546s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:27:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:27:59 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910 Apr 10 18:27:59 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:00 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0a590a50-f64c-4f64-9e6b-74861fd60910" returned: 0 in 0.441s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "cinder-quobyte-0a590a50-f64c-4f64-9e6b-74861fd60910" released by "delete_volume" :: held 1.029s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Created reservations ['78e49bf0-9669-4ec1-b254-aa98385324d3'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Flow 'volume_create_manager' (17ec6a00-90d5-4a0b-9c37-b4e5b3b8291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8106d632-0e1c-4ba1-b79c-56f2b52847ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8106d632-0e1c-4ba1-b79c-56f2b52847ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-976938010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1eb09c-334b-4b43-a794-0db471909bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a224da22d4b348d2ad261118d9068c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:00Z,use_quota=True,user_id='351fc373817c401899ec43de74b9c7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7d12eb-2dc4-4350-95a3-b386ba88d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7d12eb-2dc4-4350-95a3-b386ba88d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c0bf4-bece-4c24-8776-2bcbe29e3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c0bf4-bece-4c24-8776-2bcbe29e3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1eb09c-334b-4b43-a794-0db471909bcf', 'volume_name': 'volume-fa1eb09c-334b-4b43-a794-0db471909bcf', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7add04-3d05-41b2-a3bf-ee17f6a7cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7add04-3d05-41b2-a3bf-ee17f6a7cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d39a91-c2d6-4ab5-aa5a-a71d4e627272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Volume fa1eb09c-334b-4b43-a794-0db471909bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1eb09c-334b-4b43-a794-0db471909bcf', 'volume_size': 1} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-976938010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1eb09c-334b-4b43-a794-0db471909bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a224da22d4b348d2ad261118d9068c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:00Z,use_quota=True,user_id='351fc373817c401899ec43de74b9c7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Creating volume fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:00 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:00 devstack cinder-volume[82020]: WARNING cinder.quota [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-567683423 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-567683423, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:00 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf 1073741824 Apr 10 18:28:00 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Created reservations ['37af5c5f-1725-433d-9269-fe8fe193b041', '0378acee-a65a-439c-a6e6-2b5882501293', '3572839e-9162-4533-b56a-cc227fdafa61', '23457144-d3b7-401e-9511-1c22aa17e51a'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:00 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:00 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (6bd5fdb3-783e-47e3-a59e-771a311f5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ed9f84-6a1a-4b3a-a85b-3a4ded0a1be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85ed9f84-6a1a-4b3a-a85b-3a4ded0a1be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880324783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afbdd409-3249-47e1-938b-a4a9fc336e62,host='devstack@QuobyteHD#QuobyteHD',id=e832c0ef-c99e-40ae-b6d9-cfec6ea98625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:01Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd3b5b1-cd5e-4ba2-bb85-7cb76a8db1a3),volume_type_id=8fd3b5b1-cd5e-4ba2-bb85-7cb76a8db1a3)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4604451f-49b4-4530-8200-3fad1ef65920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4604451f-49b4-4530-8200-3fad1ef65920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea549d7-5f77-4899-8ad6-a0123f5a3a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea549d7-5f77-4899-8ad6-a0123f5a3a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e832c0ef-c99e-40ae-b6d9-cfec6ea98625', 'volume_name': 'volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850242d3-051f-4913-9e7d-1baa9e7efccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850242d3-051f-4913-9e7d-1baa9e7efccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e65365-b03e-44c1-8443-6fb8f24321fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:00 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Volume e832c0ef-c99e-40ae-b6d9-cfec6ea98625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625', 'volume_size': 1} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:00 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf 1073741824" returned: 0 in 0.567s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:00 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.491s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:00 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0a0bf9b2-7858-47e5-8812-17b7cc349c64 tempest-GroupSnapshotsV319Test-1241352363 None] Delete group completed successfully. Apr 10 18:28:00 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf Apr 10 18:28:00 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:01 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf" returned: 0 in 0.482s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=afbdd409-3249-47e1-938b-a4a9fc336e62,created_at=2026-04-10T16:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880324783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=afbdd409-3249-47e1-938b-a4a9fc336e62,host='devstack@QuobyteHD#QuobyteHD',id=e832c0ef-c99e-40ae-b6d9-cfec6ea98625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cece41f0cb44b19838ae4286664cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:01Z,use_quota=True,user_id='be1b0caea8524f7d944d54e9e54276a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fd3b5b1-cd5e-4ba2-bb85-7cb76a8db1a3),volume_type_id=8fd3b5b1-cd5e-4ba2-bb85-7cb76a8db1a3)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Creating volume e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:01 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d39a91-c2d6-4ab5-aa5a-a71d4e627272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1eb09c-334b-4b43-a794-0db471909bcf', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:01 devstack sudo[86443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 1073741824 Apr 10 18:28:01 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a23da1b-4636-4983-bdcb-24c0b6070eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Volume volume-fa1eb09c-334b-4b43-a794-0db471909bcf (fa1eb09c-334b-4b43-a794-0db471909bcf): created successfully Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a23da1b-4636-4983-bdcb-24c0b6070eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Flow 'volume_create_manager' (17ec6a00-90d5-4a0b-9c37-b4e5b3b8291c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-f3f39fab-7994-48ad-bec5-a613dd1f2fd3 req-34afcc2e-defc-486e-9e5a-c996690a249f tempest-VolumesSnapshotsTestJSON-1179358367 None] Created volume successfully. Apr 10 18:28:01 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 1073741824" returned: 0 in 0.566s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:02 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 Apr 10 18:28:02 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:02 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" returned: 0 in 0.498s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e65365-b03e-44c1-8443-6fb8f24321fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3a6481-1729-4184-9fbb-a9aea79af66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Volume volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 (e832c0ef-c99e-40ae-b6d9-cfec6ea98625): created successfully Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3a6481-1729-4184-9fbb-a9aea79af66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Flow 'volume_create_manager' (6bd5fdb3-783e-47e3-a59e-771a311f5e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-264854c4-381d-488a-8cb9-ac1a1f2a548b tempest-GroupSnapshotsTest-866023021 None] Created volume successfully. Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Creating offline snapshot 9ae5f907-8d49-472c-9270-a8703f86cca1 of volume fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9f333-7205-409d-b3af-9cc27de6dc08]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:02 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf Apr 10 18:28:02 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] GroupSnapshot 5384f7ba-b923-4946-83a0-ab5979ca7d98: creating. Apr 10 18:28:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Group snapshot 5384f7ba-b923-4946-83a0-ab5979ca7d98: creating. {{(pid=82020) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 18:28:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:03 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf" returned: 0 in 0.640s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:03 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 1G Apr 10 18:28:03 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:03 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 1G" returned: 0 in 0.674s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1eb09c-334b-4b43-a794-0db471909bcf -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:04 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1eb09c-334b-4b43-a794-0db471909bcf -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 Apr 10 18:28:04 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:04 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1eb09c-334b-4b43-a794-0db471909bcf -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1" returned: 0 in 0.721s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:04 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 is being set with open permissions: ugo+rw Apr 10 18:28:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:04 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 Apr 10 18:28:04 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:05 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1" returned: 0 in 0.497s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:05 devstack sudo[86508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info Apr 10 18:28:05 devstack sudo[86508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:05 devstack sudo[86508]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info" returned: 0 in 0.542s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:05 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info is being set with open permissions: ugo+rw Apr 10 18:28:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:05 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info Apr 10 18:28:05 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af37f7d7-be62-4cd0-a463-9fe777b1c3f1 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" by "attach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af37f7d7-be62-4cd0-a463-9fe777b1c3f1 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" acquired by "attach_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-af37f7d7-be62-4cd0-a463-9fe777b1c3f1 tempest-VolumesActionsTest-1453102242 None] Attaching volume d1fdb31e-4af5-46f0-bd8c-794acc9da1ce to instance 6494548d-4601-4c97-8364-c3c0b7fb8dc8 at mountpoint /dev/vdb on host None. Apr 10 18:28:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-af37f7d7-be62-4cd0-a463-9fe777b1c3f1 tempest-VolumesActionsTest-1453102242 None] Attach volume completed successfully. Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af37f7d7-be62-4cd0-a463-9fe777b1c3f1 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" released by "attach_volume" :: held 0.112s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:06 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.info" returned: 0 in 0.624s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.772s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.329s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-916da342-2e6e-460e-bfb1-b4ac6dae10e6 req-a64e75ef-dc18-46a0-9ce7-62cbbe3ec4d8 tempest-VolumesSnapshotsTestJSON-1179358367 None] Create snapshot completed successfully Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Creating offline snapshot 350b7241-0df8-4713-95ba-dfa2c25c0c45 of volume e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d1c4a6-f5d7-4c36-969a-03f2c4913796]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:06 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 Apr 10 18:28:06 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-12703f76-0bf8-4b04-b519-d2c833acf4cb tempest-VolumesActionsTest-1453102242 None] Acquiring lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-detach_volume" by "detach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-12703f76-0bf8-4b04-b519-d2c833acf4cb tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-12703f76-0bf8-4b04-b519-d2c833acf4cb tempest-VolumesActionsTest-1453102242 None] Detaching volume d1fdb31e-4af5-46f0-bd8c-794acc9da1ce from instance 6494548d-4601-4c97-8364-c3c0b7fb8dc8. Apr 10 18:28:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-12703f76-0bf8-4b04-b519-d2c833acf4cb tempest-VolumesActionsTest-1453102242 None] Detach volume completed successfully. Apr 10 18:28:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-12703f76-0bf8-4b04-b519-d2c833acf4cb tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:07 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" returned: 0 in 0.624s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:07 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 1G Apr 10 18:28:07 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "cinder-9ae5f907-8d49-472c-9270-a8703f86cca1-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-9ae5f907-8d49-472c-9270-a8703f86cca1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "cinder-quobyte-fa1eb09c-334b-4b43-a794-0db471909bcf" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-quobyte-fa1eb09c-334b-4b43-a794-0db471909bcf" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "cinder-quobyte-9ae5f907-8d49-472c-9270-a8703f86cca1" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-quobyte-9ae5f907-8d49-472c-9270-a8703f86cca1" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Deleting offline snapshot 9ae5f907-8d49-472c-9270-a8703f86cca1 of volume fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] snapshot_file for this snap is: volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6942e59a-b18b-4366-9be1-5b1504b03ef2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:07 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 Apr 10 18:28:07 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:08 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 1G" returned: 0 in 0.891s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:08 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1" returned: 0 in 0.673s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1eb09c-334b-4b43-a794-0db471909bcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:28:08 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 Apr 10 18:28:08 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb05b71-bc0f-48ed-9ef0-b7dbbf6a9714]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:08 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf Apr 10 18:28:08 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6286ea52-173d-492e-8696-794e687ed6d5 tempest-GroupsV320Test-923334227 None] Group tempest-GroupsV320Test-Group-363836343: creating Apr 10 18:28:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6286ea52-173d-492e-8696-794e687ed6d5 tempest-GroupsV320Test-923334227 None] Group tempest-GroupsV320Test-Group-363836343: created successfully Apr 10 18:28:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6286ea52-173d-492e-8696-794e687ed6d5 tempest-GroupsV320Test-923334227 None] Create group completed successfully. Apr 10 18:28:08 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45" returned: 0 in 0.592s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:08 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:08 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 Apr 10 18:28:08 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:08 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf" returned: 0 in 0.697s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:08 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 Apr 10 18:28:08 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:09 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45" returned: 0 in 0.582s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:09 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info Apr 10 18:28:09 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:09 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1" returned: 0 in 0.602s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:09 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1 Apr 10 18:28:09 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:09 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:09 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:09 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info Apr 10 18:28:09 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:09 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf.9ae5f907-8d49-472c-9270-a8703f86cca1" returned: 0 in 0.512s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-quobyte-9ae5f907-8d49-472c-9270-a8703f86cca1" released by "_delete_snapshot" :: held 2.586s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-quobyte-fa1eb09c-334b-4b43-a794-0db471909bcf" released by "delete_snapshot" :: held 2.597s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Created reservations ['903ea30b-db84-4030-bb04-630275b0a3a0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:09 devstack cinder-volume[82020]: DEBUG cinder.quota [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Created reservations ['6521d180-9e26-460a-a2ff-59756093e84e', 'da86835f-1f7d-4a7b-b7de-e7ae3aaa6485', '89f40211-f48e-4491-a6fd-f64245541fb6', '9b079f6c-1763-4e07-a7aa-9f82b9bfc0f0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Delete snapshot completed successfully. Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-33c5f27b-0c55-4df4-8c43-5c564d7998e6 req-bf8dff2b-a58c-48ee-8ad0-60b65d367bcd tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-9ae5f907-8d49-472c-9270-a8703f86cca1-delete_snapshot" released by "delete_snapshot" :: held 2.747s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:10 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:10 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:10 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.info" returned: 0 in 0.517s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.823s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b5aa26d5-96ad-4e45-b2ab-4b7055a5a903 tempest-GroupSnapshotsTest-866023021 None] group_snapshot 5384f7ba-b923-4946-83a0-ab5979ca7d98: created successfully Apr 10 18:28:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] group_snapshot 5384f7ba-b923-4946-83a0-ab5979ca7d98: deleting Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] group_snapshot 5384f7ba-b923-4946-83a0-ab5979ca7d98: deleting {{(pid=82020) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-350b7241-0df8-4713-95ba-dfa2c25c0c45" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-350b7241-0df8-4713-95ba-dfa2c25c0c45" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Deleting offline snapshot 350b7241-0df8-4713-95ba-dfa2c25c0c45 of volume e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] snapshot_file for this snap is: volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a256d37-fdff-45fa-85e9-e6651ab37252]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:10 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.530s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e415f395-72ae-4d69-bd4c-b0f118c48b6b tempest-GroupsV320Test-923334227 None] Delete group completed successfully. Apr 10 18:28:10 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 Apr 10 18:28:10 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "cinder-fa1eb09c-334b-4b43-a794-0db471909bcf-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-fa1eb09c-334b-4b43-a794-0db471909bcf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "cinder-quobyte-fa1eb09c-334b-4b43-a794-0db471909bcf" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-quobyte-fa1eb09c-334b-4b43-a794-0db471909bcf" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1405fb8f-8941-4509-a5d9-6bba5134c18c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:10 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf Apr 10 18:28:10 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:11 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45" returned: 0 in 0.526s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f6be9d-9971-4859-8855-263991ac5870]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:11 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 Apr 10 18:28:11 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:11 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf" returned: 0 in 0.614s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:11 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf Apr 10 18:28:11 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:11 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" returned: 0 in 0.573s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:11 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 Apr 10 18:28:11 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:11 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa1eb09c-334b-4b43-a794-0db471909bcf" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-quobyte-fa1eb09c-334b-4b43-a794-0db471909bcf" released by "delete_volume" :: held 1.168s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG cinder.quota [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Created reservations ['08f92381-b87d-4d5a-8290-cdbaa495ef96', '99ad198b-8d0a-4e22-87e7-59830325b00d', 'eba8f834-dcb4-4230-83df-9100d78e4236', '11456301-94a3-42c3-820a-398891b813f6'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:11 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:11 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:12 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45" returned: 0 in 0.558s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:12 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45 Apr 10 18:28:12 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:12 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG cinder.manager [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Deleted volume successfully. Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [req-e8655b8d-df11-4a2c-aeaa-3c6716f63192 req-82a33fc7-da2c-4eb0-b696-a258098d4c7c tempest-VolumesSnapshotsTestJSON-1179358367 None] Lock "cinder-fa1eb09c-334b-4b43-a794-0db471909bcf-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:12 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625.350b7241-0df8-4713-95ba-dfa2c25c0c45" returned: 0 in 0.495s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-350b7241-0df8-4713-95ba-dfa2c25c0c45" released by "_delete_snapshot" :: held 2.212s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" released by "delete_snapshot" :: held 2.224s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:12 devstack cinder-volume[82020]: WARNING cinder.quota [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1596841202 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1596841202, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:12 devstack cinder-volume[82020]: WARNING cinder.quota [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1596841202 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1596841202, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:12 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['d799464a-7119-4cf4-8606-18fff02e2feb', 'eb222085-65fe-44dc-a4a0-639a3c9a02d8', 'a55960ff-a08a-446e-ae70-cb9a922836bf', 'a6acac0a-fd22-4dae-b9b0-7fa654f99b79'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-074ebfe3-425a-4ec1-be2d-cd34d6eb6636 tempest-GroupSnapshotsTest-866023021 None] group_snapshot 5384f7ba-b923-4946-83a0-ab5979ca7d98: deleted successfully Apr 10 18:28:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "cinder-quobyte-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" acquired by "delete_volume" :: waited 0.018s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:13 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0283e18b-0e88-4642-9478-fb5218d5b8f3]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:14 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 Apr 10 18:28:14 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:14 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" returned: 0 in 0.573s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:14 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625 Apr 10 18:28:14 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:15 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" returned: 0 in 0.471s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Lock "cinder-quobyte-e832c0ef-c99e-40ae-b6d9-cfec6ea98625" released by "delete_volume" :: held 1.095s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['0dac452c-582b-48a2-921f-71d16ad84672'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf3ee3e-97d3-4717-9b28-15c576ded07c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:15 devstack cinder-volume[82020]: WARNING cinder.quota [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1596841202 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1596841202, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Created reservations ['b3a40cb6-815a-4dd0-bf4a-b5622cd7556e', '15ec2207-41f4-4cfa-ba3d-03262cab5af0', 'e1ba8777-8c3a-46cf-bbd4-509883a2808d', 'b65afac4-1c20-45b8-bb0f-025d164e3820'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:15 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:15 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:15 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:15 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:15 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.453s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:15 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0a6afd22-d8b0-468d-ad6a-73533ef6e2c7 tempest-GroupSnapshotsTest-866023021 None] Delete group completed successfully. Apr 10 18:28:15 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.648s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e65ccd-7609-47a4-8f98-637036effac9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:15 devstack sudo[86635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:15 devstack sudo[86635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:16 devstack sudo[86635]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.616s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.d7cabf2f-9d64-43cb-be35-dc10afcea0250ku9bydm.img {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:16 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.d7cabf2f-9d64-43cb-be35-dc10afcea0250ku9bydm.img Apr 10 18:28:16 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:16 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:16 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:17 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.925s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:19 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.d7cabf2f-9d64-43cb-be35-dc10afcea0250ku9bydm.img" returned: 0 in 2.667s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:19 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e1b68-09bc-4c28-ab31-74071fbf838b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:19 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:19 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-80900bfd-1902-4b9a-8903-4b7c30750a39 tempest-GroupsTest-2090925876 None] Group tempest-Group1-1654795208: creating Apr 10 18:28:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-80900bfd-1902-4b9a-8903-4b7c30750a39 tempest-GroupsTest-2090925876 None] Group tempest-Group1-1654795208: created successfully Apr 10 18:28:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-80900bfd-1902-4b9a-8903-4b7c30750a39 tempest-GroupsTest-2090925876 None] Create group completed successfully. Apr 10 18:28:19 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.717s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:19 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce, size 1024.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.d7cabf2f-9d64-43cb-be35-dc10afcea0250ku9bydm.img {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:28:19 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Converted 1024.00 MB image at 383.66 MB/s Apr 10 18:28:19 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] d7cabf2f-9d64-43cb-be35-dc10afcea025 was raw, no need to convert to raw {{(pid=82020) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 18:28:20 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7edf9dfe-4087-441d-badb-1089c4e2c344 tempest-GroupsTest-2090925876 None] Group tempest-Group2-452217230: creating Apr 10 18:28:20 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7edf9dfe-4087-441d-badb-1089c4e2c344 tempest-GroupsTest-2090925876 None] Group tempest-Group2-452217230: created successfully Apr 10 18:28:20 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7edf9dfe-4087-441d-badb-1089c4e2c344 tempest-GroupsTest-2090925876 None] Create group completed successfully. Apr 10 18:28:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-50526eb4-9dc3-42ea-9dde-e25b7a03886b tempest-GroupsV314Test-1336186088 None] Group tempest-GroupsV314Test-Group-1597506834: creating Apr 10 18:28:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-50526eb4-9dc3-42ea-9dde-e25b7a03886b tempest-GroupsV314Test-1336186088 None] Group tempest-GroupsV314Test-Group-1597506834: created successfully Apr 10 18:28:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-50526eb4-9dc3-42ea-9dde-e25b7a03886b tempest-GroupsV314Test-1336186088 None] Create group completed successfully. Apr 10 18:28:21 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Flow 'volume_create_manager' (896315fb-7400-4ef9-9087-d10b82308383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0193a0a5-13fd-4fb4-b8b2-7dc896671d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0193a0a5-13fd-4fb4-b8b2-7dc896671d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-567637910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b430df-9adc-4b16-987c-c74e069727c7,host='devstack@QuobyteHD#QuobyteHD',id=c5d531f6-7238-4d19-b37e-1eb36ee92652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b674d9902c411b9b04930c298e888f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:22Z,use_quota=True,user_id='c0149ec729e740b1bc4d0af71ef851d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efa46d10-f799-4bba-966b-13f0ba0cb0bc),volume_type_id=efa46d10-f799-4bba-966b-13f0ba0cb0bc)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d474150e-1b93-45a0-a6e3-cb1b973ad849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d474150e-1b93-45a0-a6e3-cb1b973ad849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353e27ce-7708-4e83-a66f-5e0666316d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353e27ce-7708-4e83-a66f-5e0666316d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d531f6-7238-4d19-b37e-1eb36ee92652', 'volume_name': 'volume-c5d531f6-7238-4d19-b37e-1eb36ee92652', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e8b1ae-b6de-41ca-a6bf-fe4ffb6f168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e8b1ae-b6de-41ca-a6bf-fe4ffb6f168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7201d30-6d33-47ca-a257-a5aee290c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Volume c5d531f6-7238-4d19-b37e-1eb36ee92652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d531f6-7238-4d19-b37e-1eb36ee92652', 'volume_size': 1} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Flow 'volume_create_manager' (edd13737-b151-447d-b225-23688b82bb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f87d0d-1379-47ae-a9af-a8ffe666ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f87d0d-1379-47ae-a9af-a8ffe666ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-299990271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a06f847-9a27-48b6-8b5d-53c0550865b1,host='devstack@QuobyteHD#QuobyteHD',id=0bea0be5-f118-4a65-b659-b960d2cfc1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d7abf89a5148fbab8eee93f741a8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:22Z,use_quota=True,user_id='8dcf1d64c0884c47852c6c9fbd1db678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54893d32-19e7-49a6-b049-c534c0ceae33),volume_type_id=54893d32-19e7-49a6-b049-c534c0ceae33)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4e070-7892-455e-9004-a542d8d93108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f4e070-7892-455e-9004-a542d8d93108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5071ef10-b715-44fd-bcb8-3ea43772d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5071ef10-b715-44fd-bcb8-3ea43772d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bea0be5-f118-4a65-b659-b960d2cfc1a9', 'volume_name': 'volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d2f2a5-a816-4e1a-baf0-66ff26ead154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d2f2a5-a816-4e1a-baf0-66ff26ead154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373d1775-3622-472c-8575-008150ff3c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:22 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Volume 0bea0be5-f118-4a65-b659-b960d2cfc1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9', 'volume_size': 1} Apr 10 18:28:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.465s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Uploaded volume to glance image-id: d7cabf2f-9d64-43cb-be35-dc10afcea025. {{(pid=82020) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.526s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14b430df-9adc-4b16-987c-c74e069727c7,created_at=2026-04-10T16:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-567637910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14b430df-9adc-4b16-987c-c74e069727c7,host='devstack@QuobyteHD#QuobyteHD',id=c5d531f6-7238-4d19-b37e-1eb36ee92652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b674d9902c411b9b04930c298e888f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:22Z,use_quota=True,user_id='c0149ec729e740b1bc4d0af71ef851d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efa46d10-f799-4bba-966b-13f0ba0cb0bc),volume_type_id=efa46d10-f799-4bba-966b-13f0ba0cb0bc)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Creating volume c5d531f6-7238-4d19-b37e-1eb36ee92652 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:30 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:30 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 1073741824 Apr 10 18:28:30 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a7b732a1-fd06-456b-a2aa-579f6267597e tempest-VolumesActionsTest-1453102242 None] Copy volume to image completed successfully. Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Flow 'volume_create_manager' (ef217029-1681-4914-b473-918f5e2bd1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7de546-9942-400a-a450-8b29eeba8d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7de546-9942-400a-a450-8b29eeba8d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1343420711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a530268-db56-470c-8643-0f1d43789000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d2d35afb64c7b869a5ea780cdf410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:30Z,use_quota=True,user_id='34b7035dc06548b2963f23cc31cbbb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ffca70-0dd4-41e5-9213-cba760a13cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ffca70-0dd4-41e5-9213-cba760a13cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001697f9-674f-4279-b331-0102e162aafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001697f9-674f-4279-b331-0102e162aafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a530268-db56-470c-8643-0f1d43789000', 'volume_name': 'volume-8a530268-db56-470c-8643-0f1d43789000', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d511df-e8de-45d7-9b12-08aedd3ed110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d511df-e8de-45d7-9b12-08aedd3ed110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272eec31-6f1d-47fd-b1ab-6894cea63734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:30 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Volume 8a530268-db56-470c-8643-0f1d43789000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a530268-db56-470c-8643-0f1d43789000', 'volume_size': 1} Apr 10 18:28:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:31 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 1073741824" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:31 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 Apr 10 18:28:31 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:31 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652" returned: 0 in 0.407s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.990s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a06f847-9a27-48b6-8b5d-53c0550865b1,created_at=2026-04-10T16:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-299990271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a06f847-9a27-48b6-8b5d-53c0550865b1,host='devstack@QuobyteHD#QuobyteHD',id=0bea0be5-f118-4a65-b659-b960d2cfc1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d7abf89a5148fbab8eee93f741a8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:22Z,use_quota=True,user_id='8dcf1d64c0884c47852c6c9fbd1db678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54893d32-19e7-49a6-b049-c534c0ceae33),volume_type_id=54893d32-19e7-49a6-b049-c534c0ceae33)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Creating volume 0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:31 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7201d30-6d33-47ca-a257-a5aee290c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d531f6-7238-4d19-b37e-1eb36ee92652', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:31 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 1073741824 Apr 10 18:28:31 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9631ff9a-1cee-4c96-88ed-b0eb031a24b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:31 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Volume volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 (c5d531f6-7238-4d19-b37e-1eb36ee92652): created successfully Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9631ff9a-1cee-4c96-88ed-b0eb031a24b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Flow 'volume_create_manager' (896315fb-7400-4ef9-9087-d10b82308383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-25441448-36e1-4494-8efd-4db2c3d98b1b tempest-GroupsTest-2090925876 None] Created volume successfully. Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Acquiring lock "cinder-quobyte-c5d531f6-7238-4d19-b37e-1eb36ee92652" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Lock "cinder-quobyte-c5d531f6-7238-4d19-b37e-1eb36ee92652" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a033a9b2-0e77-4d45-82d6-67a5da249543]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:32 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 1073741824" returned: 0 in 0.598s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:32 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 Apr 10 18:28:32 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:32 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:32 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:32 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:32 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1343420711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a530268-db56-470c-8643-0f1d43789000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d2d35afb64c7b869a5ea780cdf410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:30Z,use_quota=True,user_id='34b7035dc06548b2963f23cc31cbbb6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Creating volume 8a530268-db56-470c-8643-0f1d43789000 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:32 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373d1775-3622-472c-8575-008150ff3c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdf1d26-fd5d-4140-bba2-f33d877ce872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:32 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 1073741824 Apr 10 18:28:32 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652" returned: 0 in 0.582s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:32 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Volume volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 (0bea0be5-f118-4a65-b659-b960d2cfc1a9): created successfully Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdf1d26-fd5d-4140-bba2-f33d877ce872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:32 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652 Apr 10 18:28:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Flow 'volume_create_manager' (edd13737-b151-447d-b225-23688b82bb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:32 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:32 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-931a6e4b-09c4-40b0-b910-bd5c69475cc8 tempest-GroupsV314Test-1336186088 None] Created volume successfully. Apr 10 18:28:33 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-c5d531f6-7238-4d19-b37e-1eb36ee92652" returned: 0 in 0.432s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Lock "cinder-quobyte-c5d531f6-7238-4d19-b37e-1eb36ee92652" released by "delete_volume" :: held 1.043s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:33 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 1073741824" returned: 0 in 0.480s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Created reservations ['b780f7d9-c684-402d-a90b-c65838f0cfad'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:33 devstack cinder-volume[82020]: WARNING cinder.quota [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-825304946 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-825304946, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:33 devstack cinder-volume[82020]: WARNING cinder.quota [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-825304946 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-825304946, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Created reservations ['e40d22b8-bf3a-4add-a417-c87b2f26ba4d', '55b0fb1e-083d-42e2-b7ff-686ff5b0435f', 'c6667696-3cda-4e55-8679-669e3d66e7fb', 'e6489343-6789-491a-834c-b41357b15f71'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:33 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 Apr 10 18:28:33 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:33 devstack sudo[86701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:33 devstack sudo[86701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:33 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000" returned: 0 in 0.427s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.299s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (272eec31-6f1d-47fd-b1ab-6894cea63734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a530268-db56-470c-8643-0f1d43789000', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2607f4bc-f7eb-4c30-a8c3-260717bfa35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d7096-a47a-496f-aec1-32469a1692d8]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:33 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Volume volume-8a530268-db56-470c-8643-0f1d43789000 (8a530268-db56-470c-8643-0f1d43789000): created successfully Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2607f4bc-f7eb-4c30-a8c3-260717bfa35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Flow 'volume_create_manager' (ef217029-1681-4914-b473-918f5e2bd1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d9724ca8-abc0-497b-b137-8c9a4e49a5e6 tempest-VolumesServicesTestJSON-1888511570 None] Created volume successfully. Apr 10 18:28:33 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:33 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:33 devstack sudo[86701]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.454s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f717d8a8-6ee9-44fe-bc2f-c9dd47166056 tempest-GroupsTest-2090925876 None] Delete group completed successfully. Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Acquiring lock "cinder-8a530268-db56-470c-8643-0f1d43789000-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Lock "cinder-8a530268-db56-470c-8643-0f1d43789000-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Acquiring lock "cinder-quobyte-8a530268-db56-470c-8643-0f1d43789000" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Lock "cinder-quobyte-8a530268-db56-470c-8643-0f1d43789000" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcce4b23-b327-4f0b-9f5b-aaaa4317638f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:34 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 Apr 10 18:28:34 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:34 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.553s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b4c252-bbfa-4527-b52d-4dacee753ba3]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:34 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:34 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Created reservations ['10ffe911-72bd-409b-91e7-dda1754ae3c9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:34 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:34 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:34 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000" returned: 0 in 0.558s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:34 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000 Apr 10 18:28:34 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:34 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:34 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img Apr 10 18:28:34 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:34 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.437s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:34 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-321464e8-9fea-4d0d-ae15-d51a172bdbbb tempest-GroupsTest-2090925876 None] Delete group completed successfully. Apr 10 18:28:34 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8a530268-db56-470c-8643-0f1d43789000" returned: 0 in 0.411s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Lock "cinder-quobyte-8a530268-db56-470c-8643-0f1d43789000" released by "delete_volume" :: held 0.992s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Created reservations ['02a9b4c7-0f59-43ac-9bfc-ace68a6394a4', '323812a7-1257-48c2-b58d-b76326efb224', 'e35a0daa-ff43-4bf7-9383-ee43e5eb9900', '6da97274-8052-4b8b-b403-c4c6f5c6d143'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:34 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:34 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:36 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.541s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:36 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Deleted volume successfully. Apr 10 18:28:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-050f3288-d0b0-4615-92ae-4929637729d0 tempest-VolumesServicesTestJSON-1888511570 None] Lock "cinder-8a530268-db56-470c-8643-0f1d43789000-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-32daac28-9fc1-4143-8aaf-cfc81b9957df tempest-GroupsTest-2090925876 None] Group tempest-GroupsTest-Group-1933019673: creating Apr 10 18:28:36 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img" returned: 0 in 2.281s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d99cd2-dab5-490d-acd6-747a80e11728]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-32daac28-9fc1-4143-8aaf-cfc81b9957df tempest-GroupsTest-2090925876 None] Group tempest-GroupsTest-Group-1933019673: created successfully Apr 10 18:28:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-32daac28-9fc1-4143-8aaf-cfc81b9957df tempest-GroupsTest-2090925876 None] Create group completed successfully. Apr 10 18:28:37 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:37 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:37 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.737s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:37 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:28:37 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Converted 1024.00 MB image at 448.78 MB/s Apr 10 18:28:37 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] b4ab8e10-4d73-42b3-b760-b8a12dd1505a was raw, converting to qcow2 {{(pid=82020) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 18:28:37 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe0dc0-a253-489d-a5a1-0f823e92b96f]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:37 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img Apr 10 18:28:37 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:38 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img" returned: 0 in 0.555s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Flow 'volume_create_manager' (d9c46b5f-8997-4310-9c22-e760e1119302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e17c22-d320-4198-82be-27f8e9c53beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:38 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img Apr 10 18:28:38 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e17c22-d320-4198-82be-27f8e9c53beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1868728199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aca6ca47-5974-4616-9f74-7ebb350792a0,host='devstack@QuobyteHD#QuobyteHD',id=8e677d12-0a7e-40fd-b3fc-5a0b904023bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b674d9902c411b9b04930c298e888f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:38Z,use_quota=True,user_id='c0149ec729e740b1bc4d0af71ef851d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f307c559-53f7-4708-9bc9-0172c4bf5ce2),volume_type_id=f307c559-53f7-4708-9bc9-0172c4bf5ce2)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f8f21f-4591-45fb-8a95-ab199e3c1e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f8f21f-4591-45fb-8a95-ab199e3c1e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0a94a4-b33a-4ebb-a56b-bdbcb9a4a0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0a94a4-b33a-4ebb-a56b-bdbcb9a4a0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e677d12-0a7e-40fd-b3fc-5a0b904023bf', 'volume_name': 'volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e56f4c-dd5d-420f-9b07-57db35f0ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e56f4c-dd5d-420f-9b07-57db35f0ae27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57aad2ac-7d0e-49e2-879c-8b32dcd01382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:38 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Volume 8e677d12-0a7e-40fd-b3fc-5a0b904023bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf', 'volume_size': 1} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:38 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img" returned: 1 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:28:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:38 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6 Apr 10 18:28:38 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:39 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6" returned: 0 in 0.425s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Image conversion details: src /opt/stack/data/cinder/conversion/d1fdb31e-4af5-46f0-bd8c-794acc9da1ce.temp_image.b4ab8e10-4d73-42b3-b760-b8a12dd1505am_7udv6y.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:28:39 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a979cb0-aba3-40b9-a746-f358f7d87e4d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:39 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6 Apr 10 18:28:39 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:39 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_kdma2xt6" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Flow 'volume_create_manager' (769aa536-f7fa-40bc-b523-cc6cb481dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e511b1e-a733-4d2b-b3d3-f3901b461b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e511b1e-a733-4d2b-b3d3-f3901b461b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1529378802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3313032b-1463-487c-af29-adfdbe0ac420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bc2265df1147f395f341f027a92709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:40Z,use_quota=True,user_id='50aec3b609cc4d8193ce9e5a03c9176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3370779-9f4a-44df-a772-11c6f0779c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3370779-9f4a-44df-a772-11c6f0779c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ac20a1-e2ee-4df4-b6d4-7508c7b99cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ac20a1-e2ee-4df4-b6d4-7508c7b99cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3313032b-1463-487c-af29-adfdbe0ac420', 'volume_name': 'volume-3313032b-1463-487c-af29-adfdbe0ac420', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425c160e-4fd5-4721-a089-731b35480a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425c160e-4fd5-4721-a089-731b35480a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902d282b-8b81-4147-bdd6-dfd81efb932c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:39 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Volume 3313032b-1463-487c-af29-adfdbe0ac420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3313032b-1463-487c-af29-adfdbe0ac420', 'volume_size': 1} Apr 10 18:28:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:40 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Uploaded volume to glance image-id: b4ab8e10-4d73-42b3-b760-b8a12dd1505a. {{(pid=82020) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 18:28:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.505s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:40 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Cloning volume 0bea0be5-f118-4a65-b659-b960d2cfc1a9 to volume 4bb934fb-868a-4945-a4eb-2bb05fab000b Apr 10 18:28:40 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-cbcdc1de-4348-4a4e-abf3-0586e2c5b305 tempest-VolumesActionsTest-1453102242 None] Copy volume to image completed successfully. Apr 10 18:28:40 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Creating offline snapshot 6008ebba-7b02-4a41-9d65-9073f9644912 of volume 0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:28:40 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c964468f-9b2d-4734-ae42-c58c80022175]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:40 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:40 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:41 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.471s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:41 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 1G Apr 10 18:28:41 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:41 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 1G" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:41 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 Apr 10 18:28:41 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:42 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:42 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "cinder-quobyte-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:42 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 Apr 10 18:28:42 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-quobyte-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f33ab0-0cad-4f4c-b3c7-817c287c8b89]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:42 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:42 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:42 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912" returned: 0 in 0.403s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:42 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info Apr 10 18:28:42 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:42 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:42 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce Apr 10 18:28:42 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:42 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:42 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:28:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:42 devstack sudo[86832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info Apr 10 18:28:42 devstack sudo[86832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:43 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" returned: 0 in 0.435s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-quobyte-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce" released by "delete_volume" :: held 0.933s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Created reservations ['e78ebc6d-b12c-4627-892d-f663c0b6fbd2', 'ad9d9465-04b5-43d5-adbb-5b81781602a5', '68e4ac2f-c9c2-4865-9dc0-3154ed17da73', '556e6cd1-1ef3-4c59-9e3f-ccd7e8361d8f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:43 devstack sudo[86834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:43 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:43 devstack sudo[86832]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.info" returned: 0 in 0.454s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Acquiring lock "cinder-quobyte-4bb934fb-868a-4945-a4eb-2bb05fab000b" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-4bb934fb-868a-4945-a4eb-2bb05fab000b" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] snapshot: 6008ebba-7b02-4a41-9d65-9073f9644912, volume: 4bb934fb-868a-4945-a4eb-2bb05fab000b, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a3a5d-8806-40eb-882d-1293f3890e83]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:43 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 Apr 10 18:28:43 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:43 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:43 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Deleted volume successfully. Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc66714c-67ae-4704-9967-d44e99daf5d3 tempest-VolumesActionsTest-1453102242 None] Lock "cinder-d1fdb31e-4af5-46f0-bd8c-794acc9da1ce-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:43 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912" returned: 0 in 0.524s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a410a33-4f90-463b-b6ec-378ee8f04b1e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:43 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:43 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:44 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:44 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:28:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:44 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b Apr 10 18:28:44 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:46 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b" returned: 0 in 2.323s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:46 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d30c1b8-64db-4f09-8890-f5ae51e76427]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:46 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:46 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:47 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.694s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:28:47 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Converted 1024.00 MB image at 440.51 MB/s Apr 10 18:28:47 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b is being set with open permissions: ugo+rw: NotImplementedError Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:47 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b Apr 10 18:28:47 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:47 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-4bb934fb-868a-4945-a4eb-2bb05fab000b" released by "_copy_volume_from_snapshot" :: held 4.588s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=165,cinder:INSERT=39,cinder:UPDATE=167,cinder:DELETE=4 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Acquiring lock "cinder-quobyte-6008ebba-7b02-4a41-9d65-9073f9644912" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-6008ebba-7b02-4a41-9d65-9073f9644912" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Deleting offline snapshot 6008ebba-7b02-4a41-9d65-9073f9644912 of volume 0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:28:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] snapshot_file for this snap is: volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5986a9-8e79-468b-9158-12ae545f0296]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:INSERT=40,cinder:SELECT=181,cinder:UPDATE=155,cinder:DELETE=7 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (2c3adb48-c540-4aec-8b5b-d8008a1104dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca75af0-dbf6-46ed-b7b5-cf8a53d4a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca75af0-dbf6-46ed-b7b5-cf8a53d4a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-778903499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4221a815-fa68-4ddf-b84b-ad525f4283b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:48Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:48 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 Apr 10 18:28:48 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c386ab-8a48-48bf-80f1-b9b6aba23b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c386ab-8a48-48bf-80f1-b9b6aba23b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8686db-1304-40c7-a1df-9770db976781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8686db-1304-40c7-a1df-9770db976781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4221a815-fa68-4ddf-b84b-ad525f4283b5', 'volume_name': 'volume-4221a815-fa68-4ddf-b84b-ad525f4283b5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292dad06-4c6f-4e5f-8b7c-1b568f7ba697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (292dad06-4c6f-4e5f-8b7c-1b568f7ba697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faf4577-48ce-450e-b754-1e38de5973e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:48 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Volume 4221a815-fa68-4ddf-b84b-ad525f4283b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4221a815-fa68-4ddf-b84b-ad525f4283b5', 'volume_size': 1} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:48 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe855e5-4e26-42a1-8558-159dae645acf]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:48 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:48 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:48 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.465s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:48 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 Apr 10 18:28:48 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:49 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:49 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912 Apr 10 18:28:49 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:49 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9.6008ebba-7b02-4a41-9d65-9073f9644912" returned: 0 in 0.410s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-6008ebba-7b02-4a41-9d65-9073f9644912" released by "_delete_snapshot" :: held 1.865s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.286s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.456s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aca6ca47-5974-4616-9f74-7ebb350792a0,created_at=2026-04-10T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1868728199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aca6ca47-5974-4616-9f74-7ebb350792a0,host='devstack@QuobyteHD#QuobyteHD',id=8e677d12-0a7e-40fd-b3fc-5a0b904023bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b674d9902c411b9b04930c298e888f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:38Z,use_quota=True,user_id='c0149ec729e740b1bc4d0af71ef851d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f307c559-53f7-4708-9bc9-0172c4bf5ce2),volume_type_id=f307c559-53f7-4708-9bc9-0172c4bf5ce2)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Creating volume 8e677d12-0a7e-40fd-b3fc-5a0b904023bf {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:49 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:49 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf 1073741824 Apr 10 18:28:49 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:49 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-baec2d4b-2fd2-439e-83bb-5e6a6f056bb8 tempest-GroupsV314Test-1336186088 None] Create group from source-group-7a06f847-9a27-48b6-8b5d-53c0550865b1 completed successfully. Apr 10 18:28:50 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf 1073741824" returned: 0 in 0.498s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:50 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf Apr 10 18:28:50 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:50 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.946s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1529378802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3313032b-1463-487c-af29-adfdbe0ac420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bc2265df1147f395f341f027a92709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:40Z,use_quota=True,user_id='50aec3b609cc4d8193ce9e5a03c9176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Creating volume 3313032b-1463-487c-af29-adfdbe0ac420 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:50 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57aad2ac-7d0e-49e2-879c-8b32dcd01382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25ea124-a58e-4332-92d8-6f1ea5f60b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:50 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 1073741824 Apr 10 18:28:50 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:50 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Volume volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf (8e677d12-0a7e-40fd-b3fc-5a0b904023bf): created successfully Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d25ea124-a58e-4332-92d8-6f1ea5f60b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Flow 'volume_create_manager' (d9c46b5f-8997-4310-9c22-e760e1119302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-921920eb-0645-46f5-b2f6-4a2e1bb2f7ae tempest-GroupsTest-2090925876 None] Created volume successfully. Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Acquiring lock "cinder-quobyte-4bb934fb-868a-4945-a4eb-2bb05fab000b" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-4bb934fb-868a-4945-a4eb-2bb05fab000b" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9dd22c-39ea-434c-aa34-1054c6464078]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:50 devstack sudo[86901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b Apr 10 18:28:50 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:51 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 1073741824" returned: 0 in 0.495s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:51 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 Apr 10 18:28:51 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:51 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:51 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b Apr 10 18:28:51 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Flow 'volume_create_manager' (cc23adcd-7362-47c7-b328-f551cba65c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b56fa7-6a1c-4531-9bb5-1ddc2fc40dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b56fa7-6a1c-4531-9bb5-1ddc2fc40dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306590606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aca6ca47-5974-4616-9f74-7ebb350792a0,host='devstack@QuobyteHD#QuobyteHD',id=0fd4e246-e529-4a3d-bad0-69720ab74250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b674d9902c411b9b04930c298e888f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:52Z,use_quota=True,user_id='c0149ec729e740b1bc4d0af71ef851d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f307c559-53f7-4708-9bc9-0172c4bf5ce2),volume_type_id=f307c559-53f7-4708-9bc9-0172c4bf5ce2)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4021e306-8026-49f4-bf43-3bf31e360848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4021e306-8026-49f4-bf43-3bf31e360848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d62531-7167-45a9-bcf0-c0718cf90996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d62531-7167-45a9-bcf0-c0718cf90996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd4e246-e529-4a3d-bad0-69720ab74250', 'volume_name': 'volume-0fd4e246-e529-4a3d-bad0-69720ab74250', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194008eb-0fbf-448a-85d2-4fc2a79d0c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194008eb-0fbf-448a-85d2-4fc2a79d0c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c1cb54-885e-4825-bfda-49419743e599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:51 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Volume 0fd4e246-e529-4a3d-bad0-69720ab74250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd4e246-e529-4a3d-bad0-69720ab74250', 'volume_size': 1} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:51 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.688s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-778903499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4221a815-fa68-4ddf-b84b-ad525f4283b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:48Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Creating volume 4221a815-fa68-4ddf-b84b-ad525f4283b5 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:51 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902d282b-8b81-4147-bdd6-dfd81efb932c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3313032b-1463-487c-af29-adfdbe0ac420', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:51 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 1073741824 Apr 10 18:28:51 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e80742a-cfc7-4d41-92d6-908c1087ba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:51 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Volume volume-3313032b-1463-487c-af29-adfdbe0ac420 (3313032b-1463-487c-af29-adfdbe0ac420): created successfully Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e80742a-cfc7-4d41-92d6-908c1087ba9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Flow 'volume_create_manager' (769aa536-f7fa-40bc-b523-cc6cb481dedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:51 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4bb934fb-868a-4945-a4eb-2bb05fab000b" returned: 0 in 0.440s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:51 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ccb098db-c263-42a0-8bc7-2b0bbffc5b78 tempest-VolumesListAdminTestJSON-1342457646 None] Created volume successfully. Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-4bb934fb-868a-4945-a4eb-2bb05fab000b" released by "delete_volume" :: held 0.976s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Created reservations ['f5eb9e97-1e24-49e7-99f1-3304da4955a7'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:51 devstack cinder-volume[82020]: WARNING cinder.quota [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1151430179 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1151430179, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:51 devstack cinder-volume[82020]: WARNING cinder.quota [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1151430179 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1151430179, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:51 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Created reservations ['4aa5f37d-c199-469d-9ffe-fe40e99bf7c7', 'a6f38f66-ba69-4ece-b19f-e3748247e62a', 'c74a0314-98a4-49a1-920c-91daa4aed6b5', '668e0125-e850-49bd-a0c8-f88bbe49c881'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:52 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:52 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:52 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 1073741824" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:52 devstack sudo[86924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 Apr 10 18:28:52 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:52 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.440s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d87c32fe-28b9-4cf0-bf1d-8fab5e9c6e4c tempest-GroupsV314Test-1336186088 None] Delete group completed successfully. Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Flow 'volume_create_manager' (b74bb95c-8c83-4ec3-b555-094e166c0ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79efba2-834e-4b21-98d8-168814123549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79efba2-834e-4b21-98d8-168814123549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-424549376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de73ec38-9751-40fe-bac0-d8e809826168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bc2265df1147f395f341f027a92709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:53Z,use_quota=True,user_id='50aec3b609cc4d8193ce9e5a03c9176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a17de9-a5d7-4bf5-897e-6de283b76a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a17de9-a5d7-4bf5-897e-6de283b76a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b928adab-e733-4168-80c0-6f4c0dbd0335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b928adab-e733-4168-80c0-6f4c0dbd0335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de73ec38-9751-40fe-bac0-d8e809826168', 'volume_name': 'volume-de73ec38-9751-40fe-bac0-d8e809826168', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3b5fe7-1856-4414-a9c1-82342eb90694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3b5fe7-1856-4414-a9c1-82342eb90694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:52 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40dc870-f192-4a56-9706-df9408d57b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:52 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Volume de73ec38-9751-40fe-bac0-d8e809826168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de73ec38-9751-40fe-bac0-d8e809826168', 'volume_size': 1} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aca6ca47-5974-4616-9f74-7ebb350792a0,created_at=2026-04-10T16:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306590606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aca6ca47-5974-4616-9f74-7ebb350792a0,host='devstack@QuobyteHD#QuobyteHD',id=0fd4e246-e529-4a3d-bad0-69720ab74250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b674d9902c411b9b04930c298e888f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:52Z,use_quota=True,user_id='c0149ec729e740b1bc4d0af71ef851d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f307c559-53f7-4708-9bc9-0172c4bf5ce2),volume_type_id=f307c559-53f7-4708-9bc9-0172c4bf5ce2)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Creating volume 0fd4e246-e529-4a3d-bad0-69720ab74250 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:52 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3faf4577-48ce-450e-b754-1e38de5973e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4221a815-fa68-4ddf-b84b-ad525f4283b5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:52 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 1073741824 Apr 10 18:28:52 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ecdd4-84d5-4097-a7ea-f711a0915845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:52 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Volume volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 (4221a815-fa68-4ddf-b84b-ad525f4283b5): created successfully Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ecdd4-84d5-4097-a7ea-f711a0915845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (2c3adb48-c540-4aec-8b5b-d8008a1104dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a71dc576-a0cb-43c0-ac7a-04dfdd418b07 tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Acquiring lock "cinder-quobyte-0bea0be5-f118-4a65-b659-b960d2cfc1a9" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-0bea0be5-f118-4a65-b659-b960d2cfc1a9" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef4a476-212c-4bc6-b1f5-f13e83ca78d3]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:53 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:53 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:53 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 1073741824" returned: 0 in 0.546s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:53 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 Apr 10 18:28:53 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (60596553-ebdd-4a53-9eed-2314bf4fc2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb5acc7-210f-4535-8fe7-4ac29eb4f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb5acc7-210f-4535-8fe7-4ac29eb4f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-107355677',display_name='tempest-VolumesGetTest-Volume-348442379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e83b5a3-b293-4a75-a594-ff99a19298e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:54Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8327fea-b691-4417-ae46-d4b17b90c44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8327fea-b691-4417-ae46-d4b17b90c44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2371a1-8630-4161-b1af-2530863f344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2371a1-8630-4161-b1af-2530863f344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e83b5a3-b293-4a75-a594-ff99a19298e0', 'volume_name': 'volume-8e83b5a3-b293-4a75-a594-ff99a19298e0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b6564d-bf22-4809-b6f0-738efe888013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:53 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b6564d-bf22-4809-b6f0-738efe888013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030b5082-4f40-48a5-a9ca-4df26c48af78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:53 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Volume 8e83b5a3-b293-4a75-a594-ff99a19298e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e83b5a3-b293-4a75-a594-ff99a19298e0', 'volume_size': 1} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.591s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:53 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9 Apr 10 18:28:53 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:53 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-424549376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de73ec38-9751-40fe-bac0-d8e809826168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bc2265df1147f395f341f027a92709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:53Z,use_quota=True,user_id='50aec3b609cc4d8193ce9e5a03c9176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Creating volume de73ec38-9751-40fe-bac0-d8e809826168 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:53 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c1cb54-885e-4825-bfda-49419743e599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd4e246-e529-4a3d-bad0-69720ab74250', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:53 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 1073741824 Apr 10 18:28:53 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eb3720-bacb-429d-8d74-a7e37b6109a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:53 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Volume volume-0fd4e246-e529-4a3d-bad0-69720ab74250 (0fd4e246-e529-4a3d-bad0-69720ab74250): created successfully Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eb3720-bacb-429d-8d74-a7e37b6109a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Flow 'volume_create_manager' (cc23adcd-7362-47c7-b328-f551cba65c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:53 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2451777a-3826-4e56-a077-a057b95d9371 tempest-GroupsTest-2090925876 None] Created volume successfully. Apr 10 18:28:54 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0bea0be5-f118-4a65-b659-b960d2cfc1a9" returned: 0 in 0.432s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Lock "cinder-quobyte-0bea0be5-f118-4a65-b659-b960d2cfc1a9" released by "delete_volume" :: held 1.056s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Created reservations ['9f76a569-3c56-49e3-81a4-ff16dce269ca'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Created reservations ['d9b81558-3c3f-4026-b0f3-35bd84943523', 'd78d7120-04ff-4335-b1fb-19d1fea4034d', '48440b88-4bd0-4c0d-a26d-a19742dc0ff3', '4217774e-27bd-4fd1-9a8d-9c30f953a963'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:54 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:54 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:54 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 1073741824" returned: 0 in 0.488s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:54 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 Apr 10 18:28:54 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.419s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:54 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-36eb11a4-df81-4b81-913c-5b8198ef57f5 tempest-GroupsV314Test-1336186088 None] Delete group completed successfully. Apr 10 18:28:54 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6a6d2dec-3455-4f1e-ad9d-a8a576c37626 tempest-GroupsTest-2090925876 None] Update group completed successfully. Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168" returned: 0 in 0.465s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-107355677',display_name='tempest-VolumesGetTest-Volume-348442379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e83b5a3-b293-4a75-a594-ff99a19298e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:54Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Creating volume 8e83b5a3-b293-4a75-a594-ff99a19298e0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:54 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40dc870-f192-4a56-9706-df9408d57b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de73ec38-9751-40fe-bac0-d8e809826168', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:54 devstack sudo[86954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 1073741824 Apr 10 18:28:54 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e023bcc-9227-43ed-a69d-9904856bd276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:54 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Volume volume-de73ec38-9751-40fe-bac0-d8e809826168 (de73ec38-9751-40fe-bac0-d8e809826168): created successfully Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e023bcc-9227-43ed-a69d-9904856bd276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Flow 'volume_create_manager' (b74bb95c-8c83-4ec3-b555-094e166c0ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b79349fb-f21c-427a-b3b9-01b277133cf0 tempest-VolumesListAdminTestJSON-1342457646 None] Created volume successfully. Apr 10 18:28:55 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 1073741824" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:55 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 Apr 10 18:28:55 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:55 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0" returned: 0 in 0.486s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030b5082-4f40-48a5-a9ca-4df26c48af78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e83b5a3-b293-4a75-a594-ff99a19298e0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ae21d3-9601-4eea-ab77-5f8d3b15ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:55 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Volume volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 (8e83b5a3-b293-4a75-a594-ff99a19298e0): created successfully Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6ae21d3-9601-4eea-ab77-5f8d3b15ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:55 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (60596553-ebdd-4a53-9eed-2314bf4fc2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:55 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-949a337b-31ac-4001-81f4-a848490e7e89 tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:28:56 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6a34676c-ac69-41e2-a9ee-75f20ebd4674 tempest-GroupsTest-2090925876 None] Update group completed successfully. Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Flow 'volume_create_manager' (1831416e-1021-4412-91c9-d80e55d2a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e106e-5b9b-4e5a-876f-5528e24b7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100e106e-5b9b-4e5a-876f-5528e24b7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502774406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b773c9d0-51d6-4bde-b5eb-467565d21532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bc2265df1147f395f341f027a92709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:56Z,use_quota=True,user_id='50aec3b609cc4d8193ce9e5a03c9176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb940695-9256-4bfb-a16e-26488bc4a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb940695-9256-4bfb-a16e-26488bc4a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb4e051-97fb-49e3-937a-e26faedae4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb4e051-97fb-49e3-937a-e26faedae4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b773c9d0-51d6-4bde-b5eb-467565d21532', 'volume_name': 'volume-b773c9d0-51d6-4bde-b5eb-467565d21532', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b32513-bc95-4d5e-87ff-12a035ed8793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b32513-bc95-4d5e-87ff-12a035ed8793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23018d28-9af3-42ba-980d-857f8d9bcedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:56 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Volume b773c9d0-51d6-4bde-b5eb-467565d21532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b773c9d0-51d6-4bde-b5eb-467565d21532', 'volume_size': 1} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1502774406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b773c9d0-51d6-4bde-b5eb-467565d21532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69bc2265df1147f395f341f027a92709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:56Z,use_quota=True,user_id='50aec3b609cc4d8193ce9e5a03c9176a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Creating volume b773c9d0-51d6-4bde-b5eb-467565d21532 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:56 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:56 devstack sudo[86962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 1073741824 Apr 10 18:28:56 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:56 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 1073741824" returned: 0 in 0.563s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-8e83b5a3-b293-4a75-a594-ff99a19298e0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Lock "cinder-8e83b5a3-b293-4a75-a594-ff99a19298e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:57 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 Apr 10 18:28:57 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-8e83b5a3-b293-4a75-a594-ff99a19298e0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-8e83b5a3-b293-4a75-a594-ff99a19298e0" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3686626b-5bdf-4319-8846-5f04f4343e4b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:57 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 Apr 10 18:28:57 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:57 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23018d28-9af3-42ba-980d-857f8d9bcedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b773c9d0-51d6-4bde-b5eb-467565d21532', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baff448-5d45-46b5-bcb7-d1ee516f3b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:57 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Volume volume-b773c9d0-51d6-4bde-b5eb-467565d21532 (b773c9d0-51d6-4bde-b5eb-467565d21532): created successfully Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baff448-5d45-46b5-bcb7-d1ee516f3b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Flow 'volume_create_manager' (1831416e-1021-4412-91c9-d80e55d2a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Acquiring lock "cinder-quobyte-0fd4e246-e529-4a3d-bad0-69720ab74250" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:57 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-669a2ad1-4656-433d-93a6-b40a22c587ce tempest-VolumesListAdminTestJSON-1342457646 None] Created volume successfully. Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Lock "cinder-quobyte-0fd4e246-e529-4a3d-bad0-69720ab74250" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eb37b4-9e34-4805-af06-ecf006d2de38]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:57 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0" returned: 0 in 0.590s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:57 devstack sudo[86975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 Apr 10 18:28:57 devstack sudo[86975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:57 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0 Apr 10 18:28:57 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:58 devstack sudo[86975]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250" returned: 0 in 0.536s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:58 devstack sudo[86983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250 Apr 10 18:28:58 devstack sudo[86983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:58 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e83b5a3-b293-4a75-a594-ff99a19298e0" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-8e83b5a3-b293-4a75-a594-ff99a19298e0" released by "delete_volume" :: held 1.131s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Created reservations ['6a05a228-4e23-4cd6-ac5e-645d44784845', '7254a1ab-2b36-4eb8-901a-f64d155b99d4', '8d2e4930-2841-47a5-8763-4acb6596ceb4', '41cf516e-84ba-47b6-b498-85df3fbee7ae'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:58 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:28:58 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:58 devstack sudo[86983]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-0fd4e246-e529-4a3d-bad0-69720ab74250" returned: 0 in 0.492s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Lock "cinder-quobyte-0fd4e246-e529-4a3d-bad0-69720ab74250" released by "delete_volume" :: held 1.049s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Acquiring lock "cinder-quobyte-8e677d12-0a7e-40fd-b3fc-5a0b904023bf" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Lock "cinder-quobyte-8e677d12-0a7e-40fd-b3fc-5a0b904023bf" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f6c81-8fd9-4fc8-92dc-254941696d6b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:58 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf Apr 10 18:28:58 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:58 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.515s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:28:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-34269fcb-f9fd-4dd4-bc2c-8f5d157d2348 tempest-VolumesGetTest-59260795 None] Lock "cinder-8e83b5a3-b293-4a75-a594-ff99a19298e0-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Flow 'volume_create_manager' (3341e5dc-5684-4a60-973a-6e223f1688b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2d2833-98f6-4831-97d9-384493a92750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2d2833-98f6-4831-97d9-384493a92750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5280f155d4970b1c9a9f62ada8c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:59Z,use_quota=True,user_id='17a13ab2454c494ca25b636a76279c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa42926d-7301-477d-9b68-05d90ba72766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa42926d-7301-477d-9b68-05d90ba72766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa497850-8a89-4932-98b0-34787d9b5e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa497850-8a89-4932-98b0-34787d9b5e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6', 'volume_name': 'volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77410d96-4fb5-4bd2-882a-17ed0563bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77410d96-4fb5-4bd2-882a-17ed0563bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed09546-ec2b-4a16-a40b-d85472d78b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:28:58 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Volume fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6', 'volume_size': 1} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5280f155d4970b1c9a9f62ada8c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:28:59Z,use_quota=True,user_id='17a13ab2454c494ca25b636a76279c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Creating volume fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:28:58 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:28:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:58 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 1073741824 Apr 10 18:28:58 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-4221a815-fa68-4ddf-b84b-ad525f4283b5-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Lock "cinder-4221a815-fa68-4ddf-b84b-ad525f4283b5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:59 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-4221a815-fa68-4ddf-b84b-ad525f4283b5" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf" returned: 0 in 0.627s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-4221a815-fa68-4ddf-b84b-ad525f4283b5" acquired by "delete_volume" :: waited 0.037s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:28:59 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf Apr 10 18:28:59 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a5a362-3f9c-4fe5-b9fb-2c9caa7462da]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:59 devstack sudo[86998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 Apr 10 18:28:59 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:59 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 1073741824" returned: 0 in 0.617s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:59 devstack sudo[87003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 Apr 10 18:28:59 devstack sudo[87003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:59 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8e677d12-0a7e-40fd-b3fc-5a0b904023bf" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Lock "cinder-quobyte-8e677d12-0a7e-40fd-b3fc-5a0b904023bf" released by "delete_volume" :: held 1.189s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Created reservations ['3da95d5d-88e4-4c78-af09-bbe8db5153fe'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:59 devstack cinder-volume[82020]: WARNING cinder.quota [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-774843023 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-774843023, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:59 devstack cinder-volume[82020]: WARNING cinder.quota [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-774843023 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-774843023, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:28:59 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5" returned: 0 in 0.593s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Created reservations ['3b4d93b2-c329-40d4-affa-1409c37835a8', 'e43fc47b-3b4e-4012-9a1c-9c43afbce142', '07da5fc9-9546-4485-a5b5-4da61982be2d', 'c9d56258-65e9-4caf-ae19-16e6e35420c5'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:28:59 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5 Apr 10 18:28:59 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:28:59 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Created reservations ['dfa1687e-18cb-46c1-97a1-68ee39b46657', '16fee03d-5d3a-491b-9eed-23bf421e4fcd', '85522899-14c8-4b1b-b029-d4d00de0da5d', 'be809411-a2ae-403a-804c-f1a862b694f0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:00 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:00 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:00 devstack sudo[87003]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6" returned: 0 in 0.538s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed09546-ec2b-4a16-a40b-d85472d78b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb34fc5-5178-4b8c-b202-c3c526ab4cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:00 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Volume volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 (fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6): created successfully Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb34fc5-5178-4b8c-b202-c3c526ab4cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Flow 'volume_create_manager' (3341e5dc-5684-4a60-973a-6e223f1688b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f3f80340-8d49-48bd-b3db-a3cdb9e58da6 tempest-VolumesListAdminTestJSON-430621814 None] Created volume successfully. Apr 10 18:29:00 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4221a815-fa68-4ddf-b84b-ad525f4283b5" returned: 0 in 0.463s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-4221a815-fa68-4ddf-b84b-ad525f4283b5" released by "delete_volume" :: held 1.083s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Created reservations ['2e0bd3a9-6493-4812-ba66-32ee5d9b04c3', 'd23eb1d9-c8a8-4b12-9d64-838098847174', '6e53df39-07dd-4297-abf1-2dfe61591841', 'e028c004-66e0-4bbc-8555-83a835549124'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:00 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:00 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:00 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7347ba4c-2e86-4ea8-8471-9239f22ba0ec tempest-GroupsTest-2090925876 None] Delete group completed successfully. Apr 10 18:29:00 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:29:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-582f30a8-52c4-4b2f-aa66-56432bc376f2 tempest-VolumesGetTest-59260795 None] Lock "cinder-4221a815-fa68-4ddf-b84b-ad525f4283b5-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Acquiring lock "cinder-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Lock "cinder-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Acquiring lock "cinder-quobyte-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Lock "cinder-quobyte-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca2ec2f-a2c0-4d49-bd23-f9c28c7dbfab]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "cinder-b773c9d0-51d6-4bde-b5eb-467565d21532-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-b773c9d0-51d6-4bde-b5eb-467565d21532-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "cinder-quobyte-b773c9d0-51d6-4bde-b5eb-467565d21532" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-quobyte-b773c9d0-51d6-4bde-b5eb-467565d21532" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebf604f-93ca-40c6-b39f-fc42cc1393d9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:01 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 Apr 10 18:29:01 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:01 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 Apr 10 18:29:01 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (55e53980-9933-41b2-972c-9e70e6e93a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f57ac6e-b369-4d0f-96e4-ab5501894f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f57ac6e-b369-4d0f-96e4-ab5501894f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1680954288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d250334-e35e-468b-8e5f-ea293c8e878b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:02Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294e1ec6-0ff5-4e70-bb34-5f505dd400bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294e1ec6-0ff5-4e70-bb34-5f505dd400bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f26763-b009-4153-9f82-6875a19a7230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f26763-b009-4153-9f82-6875a19a7230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d250334-e35e-468b-8e5f-ea293c8e878b', 'volume_name': 'volume-8d250334-e35e-468b-8e5f-ea293c8e878b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e37b0f-f5d4-4edc-b2e2-b383ad9a8ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e37b0f-f5d4-4edc-b2e2-b383ad9a8ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473a09b6-7a4b-4c62-833f-0bc6a11d52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Volume 8d250334-e35e-468b-8e5f-ea293c8e878b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d250334-e35e-468b-8e5f-ea293c8e878b', 'volume_size': 1} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1680954288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d250334-e35e-468b-8e5f-ea293c8e878b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:02Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Creating volume 8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:01 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:01 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b 1073741824 Apr 10 18:29:01 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:02 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532" returned: 0 in 0.770s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:02 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532 Apr 10 18:29:02 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:02 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6" returned: 0 in 0.919s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:02 devstack sudo[87034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6 Apr 10 18:29:02 devstack sudo[87034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:02 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b 1073741824" returned: 0 in 0.754s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:02 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:02 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:02 devstack sudo[87034]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6" returned: 0 in 0.602s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Lock "cinder-quobyte-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6" released by "delete_volume" :: held 1.557s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Created reservations ['b7a90b17-b951-4f9c-a5c9-8e2c175f1fe3', '24edeca6-4a26-422c-bfb9-674d6005de23', '7793c48d-6097-49fa-8f34-e7ddc97a1c1b', 'd2bce1e1-127e-4b08-a2e8-bf92417743c7'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:02 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b773c9d0-51d6-4bde-b5eb-467565d21532" returned: 0 in 0.730s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-quobyte-b773c9d0-51d6-4bde-b5eb-467565d21532" released by "delete_volume" :: held 1.544s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:02 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Created reservations ['12389a15-f66e-4bbb-ba36-42a6dbb0a547', 'cd7dc097-5acf-4b26-b856-af1eb49083ba', 'e39b1339-3913-4fac-875c-5e935e6bee28', '1c341a0a-79a0-44ea-960f-5e8cc027d98c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:02 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:02 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:03 devstack sudo[87045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:03 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:03 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.634s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473a09b6-7a4b-4c62-833f-0bc6a11d52fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d250334-e35e-468b-8e5f-ea293c8e878b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a983e3-2aa7-4f3c-9755-faaabb5567ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Volume volume-8d250334-e35e-468b-8e5f-ea293c8e878b (8d250334-e35e-468b-8e5f-ea293c8e878b): created successfully Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74a983e3-2aa7-4f3c-9755-faaabb5567ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (55e53980-9933-41b2-972c-9e70e6e93a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ee9b24d5-2daf-4c2b-b973-9ca74ea5cce5 tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Flow 'volume_create_manager' (22c2d1d6-d387-4992-8493-ee4a0816a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d31380-25b2-44ba-9882-c3de92569603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d31380-25b2-44ba-9882-c3de92569603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-701120318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3337644ab323470a93fa6873279b1b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:03Z,use_quota=True,user_id='e582e041361546e08450dc3302c9cd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8843f94e-7d3f-4f87-9102-b4e81677acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8843f94e-7d3f-4f87-9102-b4e81677acc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c5f2fc-03ac-49bf-8a44-73ec886eb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c5f2fc-03ac-49bf-8a44-73ec886eb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f', 'volume_name': 'volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02874bed-b0c0-4cbd-915f-e7f64b6b3b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02874bed-b0c0-4cbd-915f-e7f64b6b3b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df07a86-a82f-4878-bf11-01b16525596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f', 'volume_size': 1} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-701120318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3337644ab323470a93fa6873279b1b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:03Z,use_quota=True,user_id='e582e041361546e08450dc3302c9cd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Creating volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:03 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:03 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.695s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:03 devstack sudo[87050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f 1073741824 Apr 10 18:29:03 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Deleted volume successfully. Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0f02949b-c56a-412b-bde5-2ec337e4c5e8 tempest-VolumesListAdminTestJSON-430621814 None] Lock "cinder-fa477ac2-6b7d-4f91-b4b2-92b3b8823cd6-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:03 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.644s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Deleted volume successfully. Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d489922-ef08-4847-aa30-980451ac8757 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-b773c9d0-51d6-4bde-b5eb-467565d21532-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "cinder-de73ec38-9751-40fe-bac0-d8e809826168-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-de73ec38-9751-40fe-bac0-d8e809826168-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "cinder-quobyte-de73ec38-9751-40fe-bac0-d8e809826168" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-quobyte-de73ec38-9751-40fe-bac0-d8e809826168" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87a901-97b4-4df6-ae4f-a58477b9db28]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:03 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 Apr 10 18:29:03 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (6958a706-7be5-42f2-8087-9ff3fd52c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5990745d-6e9d-409a-87f9-41f5dda1a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5990745d-6e9d-409a-87f9-41f5dda1a725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1571027874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8d250334-e35e-468b-8e5f-ea293c8e878b,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:04Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6099c129-38ad-46cd-8cb8-12e9e0b9247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6099c129-38ad-46cd-8cb8-12e9e0b9247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb3daa6-6ac9-4573-8bb5-39c88f74512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:04 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f 1073741824" returned: 0 in 0.701s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb3daa6-6ac9-4573-8bb5-39c88f74512d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65', 'volume_name': 'volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65', 'volume_size': 1, 'source_volid': '8d250334-e35e-468b-8e5f-ea293c8e878b', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124e8e2e-6467-490f-8c8e-fa339ca02f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (124e8e2e-6467-490f-8c8e-fa339ca02f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfc27af-8404-4acf-aeb9-45788f88f95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Volume 2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65', 'volume_size': 1, 'source_volid': '8d250334-e35e-468b-8e5f-ea293c8e878b', 'source_volstatus': 'available'} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:04 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f Apr 10 18:29:04 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:04 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168" returned: 0 in 0.616s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:04 devstack sudo[87063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168 Apr 10 18:29:04 devstack sudo[87063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:04 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" returned: 0 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.471s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:04 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Cloning volume 8d250334-e35e-468b-8e5f-ea293c8e878b to volume 2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df07a86-a82f-4878-bf11-01b16525596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e33c1a2-dcb5-42a1-a1f9-23214e4f34c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Volume volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f (7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f): created successfully Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e33c1a2-dcb5-42a1-a1f9-23214e4f34c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Flow 'volume_create_manager' (22c2d1d6-d387-4992-8493-ee4a0816a504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Creating offline snapshot 59f6a5bb-dd90-4dea-9ed5-1c8694140588 of volume 8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-450de124-6afd-446e-9331-1671e00a4439 tempest-SnapshotsActionsTest-1320397494 None] Created volume successfully. Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a86b8a0-136b-4f96-827c-3f9ad4ed7e79]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:04 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:04 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:04 devstack sudo[87063]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-de73ec38-9751-40fe-bac0-d8e809826168" returned: 0 in 0.501s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-quobyte-de73ec38-9751-40fe-bac0-d8e809826168" released by "delete_volume" :: held 1.139s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:04 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Flow 'volume_create_manager' (9da99bed-a349-47a8-afd9-471510295923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ccff5b-9b46-499b-a146-4d09a17bcd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ccff5b-9b46-499b-a146-4d09a17bcd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1920642122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b400576a-e198-4ad1-b1d1-22cd63e65ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16321dd2ed2b4284a935183de0e74e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:05Z,use_quota=True,user_id='e56949cb3e8942a3834cd5790c45d095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7a4f4a4-2cb5-42b3-a90c-38ff6d7408d3),volume_type_id=b7a4f4a4-2cb5-42b3-a90c-38ff6d7408d3)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649c7e16-fe89-4bce-bf6f-2dd1d7326e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649c7e16-fe89-4bce-bf6f-2dd1d7326e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104b2ef8-67ee-4b27-bfe8-90845f8fa131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104b2ef8-67ee-4b27-bfe8-90845f8fa131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b400576a-e198-4ad1-b1d1-22cd63e65ed6', 'volume_name': 'volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd1323b-c8c2-42ec-a504-d9359bcb90c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd1323b-c8c2-42ec-a504-d9359bcb90c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d49ba5b-4a50-43a7-8a46-e1053d7f2ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:05 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Volume b400576a-e198-4ad1-b1d1-22cd63e65ed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6', 'volume_size': 1} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Created reservations ['cfd6614e-1747-4255-8560-7b21a4377d09', 'ca8aee0d-2d10-4884-b27b-92e52fe5ea26', 'fa5b09ea-5370-4904-89c2-4609cf72bb38', '3030a934-2f87-4c29-adb8-343937be5cdc'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:05 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:05 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:05 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.540s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:05 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 1G Apr 10 18:29:05 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:05 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.412s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:05 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Deleted volume successfully. Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ccd408c6-174d-4538-8a56-b8e58c3b1999 tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-de73ec38-9751-40fe-bac0-d8e809826168-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:05 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 1G" returned: 0 in 0.478s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d250334-e35e-468b-8e5f-ea293c8e878b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:05 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d250334-e35e-468b-8e5f-ea293c8e878b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 Apr 10 18:29:05 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "cinder-3313032b-1463-487c-af29-adfdbe0ac420-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-3313032b-1463-487c-af29-adfdbe0ac420-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "cinder-quobyte-3313032b-1463-487c-af29-adfdbe0ac420" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-quobyte-3313032b-1463-487c-af29-adfdbe0ac420" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd12d33-646a-4d31-893f-67a6e26525ac]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:06 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 Apr 10 18:29:06 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:06 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d250334-e35e-468b-8e5f-ea293c8e878b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588" returned: 0 in 0.442s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:06 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 is being set with open permissions: ugo+rw Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:06 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 Apr 10 18:29:06 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:06 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420" returned: 0 in 0.478s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:06 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420 Apr 10 18:29:06 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:06 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588" returned: 0 in 0.415s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:06 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info Apr 10 18:29:06 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:06 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3313032b-1463-487c-af29-adfdbe0ac420" returned: 0 in 0.392s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-quobyte-3313032b-1463-487c-af29-adfdbe0ac420" released by "delete_volume" :: held 0.891s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Created reservations ['cc372238-0bf0-4eaf-bbdd-c60d2e74c972', '72d51b2b-6e75-497f-bd4f-591aa055c456', 'fd1fc8f7-ff4c-4bd9-aa56-6a0581b1c8e0', 'fbb21438-0d6a-4197-8198-d4ff8885bc7a'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:07 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:07 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:07 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:07 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info is being set with open permissions: ugo+rw Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:07 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info Apr 10 18:29:07 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:07 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.439s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Deleted volume successfully. Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e55e92c8-e0bd-48ab-8a2f-a5daa36863bb tempest-VolumesListAdminTestJSON-1342457646 None] Lock "cinder-3313032b-1463-487c-af29-adfdbe0ac420-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:07 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.info" returned: 0 in 0.453s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] snapshot: 59f6a5bb-dd90-4dea-9ed5-1c8694140588, volume: 2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d45a35-f659-45ed-8bdf-8f534ed7cee9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:07 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 Apr 10 18:29:07 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:08 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588" returned: 0 in 0.521s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d250334-e35e-468b-8e5f-ea293c8e878b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac3927-8206-44ff-b3dc-8b7559f6000d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:08 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:08 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:08 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:29:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:08 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 Apr 10 18:29:08 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Flow 'volume_create_manager' (f7c5f270-5ca3-40cd-90d7-53701312fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5087d0c-ec49-4e8b-937e-8d0ed7d1c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5087d0c-ec49-4e8b-937e-8d0ed7d1c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-197173943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6923d539-6c53-4930-b647-3922ee4a0b82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60867283bb054feba03c8b63c1c934ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:10Z,use_quota=True,user_id='9fbec7ae9d284a3bbceb2ffa2e082fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ad69e0-d5ab-4b5d-bfbd-6dedcad23f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ad69e0-d5ab-4b5d-bfbd-6dedcad23f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5675b2-f330-434f-b331-bc4ca2005cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5675b2-f330-434f-b331-bc4ca2005cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6923d539-6c53-4930-b647-3922ee4a0b82', 'volume_name': 'volume-6923d539-6c53-4930-b647-3922ee4a0b82', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6433aefb-9718-4a36-9d25-5b1856b37314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6433aefb-9718-4a36-9d25-5b1856b37314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48811f01-49ac-42cc-bd26-9a41a2b1a8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:10 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Volume 6923d539-6c53-4930-b647-3922ee4a0b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6923d539-6c53-4930-b647-3922ee4a0b82', 'volume_size': 1} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:10 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" returned: 0 in 2.232s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ef8b4e-c69d-4fde-9df5-3554a1499196]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:10 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:10 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:11 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.611s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:29:11 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Converted 1024.00 MB image at 458.58 MB/s Apr 10 18:29:11 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 is being set with open permissions: ugo+rw Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:11 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 Apr 10 18:29:11 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:11 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" returned: 0 in 0.403s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" released by "_copy_volume_from_snapshot" :: held 4.313s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-59f6a5bb-dd90-4dea-9ed5-1c8694140588" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-59f6a5bb-dd90-4dea-9ed5-1c8694140588" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Deleting offline snapshot 59f6a5bb-dd90-4dea-9ed5-1c8694140588 of volume 8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] snapshot_file for this snap is: volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e867827-b495-4642-9501-c20c48f8cd8d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:12 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 Apr 10 18:29:12 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:12 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d250334-e35e-468b-8e5f-ea293c8e878b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:12 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[49860b0a-ec19-4c7f-8655-81abb58a3c2b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:12 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:12 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:12 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.479s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:12 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 Apr 10 18:29:12 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:13 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:13 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588 Apr 10 18:29:13 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:13 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b.59f6a5bb-dd90-4dea-9ed5-1c8694140588" returned: 0 in 0.405s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-59f6a5bb-dd90-4dea-9ed5-1c8694140588" released by "_delete_snapshot" :: held 1.857s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.060s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.798s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1920642122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b400576a-e198-4ad1-b1d1-22cd63e65ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16321dd2ed2b4284a935183de0e74e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:05Z,use_quota=True,user_id='e56949cb3e8942a3834cd5790c45d095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7a4f4a4-2cb5-42b3-a90c-38ff6d7408d3),volume_type_id=b7a4f4a4-2cb5-42b3-a90c-38ff6d7408d3)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Creating volume b400576a-e198-4ad1-b1d1-22cd63e65ed6 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:13 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbfc27af-8404-4acf-aeb9-45788f88f95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65', 'volume_size': 1, 'source_volid': '8d250334-e35e-468b-8e5f-ea293c8e878b', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:13 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 1073741824 Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a645aa-03ab-4c76-825b-46d4ea2b8945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:13 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:13 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Volume volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 (2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65): created successfully Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a645aa-03ab-4c76-825b-46d4ea2b8945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (6958a706-7be5-42f2-8087-9ff3fd52c1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:13 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-893afafc-3057-443e-ac28-ce794d3e056b tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:29:14 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 1073741824" returned: 0 in 0.484s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:14 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 Apr 10 18:29:14 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:14 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6" returned: 0 in 0.419s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.105s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d49ba5b-4a50-43a7-8a46-e1053d7f2ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675182b9-90bf-4de6-8aa2-12f156c26cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Creating offline snapshot 251b8a6d-43b5-4f77-ac47-c6c96484add6 of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Volume volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 (b400576a-e198-4ad1-b1d1-22cd63e65ed6): created successfully Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675182b9-90bf-4de6-8aa2-12f156c26cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Flow 'volume_create_manager' (9da99bed-a349-47a8-afd9-471510295923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebda6660-c127-46a6-b613-c30824e75593]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:14 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-edd1fe75-82d3-4374-9675-81b9681f413c tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Created volume successfully. Apr 10 18:29:14 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f Apr 10 18:29:14 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (8bffb40f-f437-4b2d-9927-3c44c8f980b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe1a472-1028-407c-8999-74b08a392cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe1a472-1028-407c-8999-74b08a392cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1161144662',display_name='tempest-VolumesGetTest-Volume-626439068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b4a325-763d-4f37-a68d-20f16a10c8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:15Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3857851-0b42-439d-ae21-9cbebc0489a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3857851-0b42-439d-ae21-9cbebc0489a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535b1be-ac10-4f0a-b9ca-098d3275efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535b1be-ac10-4f0a-b9ca-098d3275efec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b4a325-763d-4f37-a68d-20f16a10c8bb', 'volume_name': 'volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db2d1d8-ca04-45fc-8307-849fa4760170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db2d1d8-ca04-45fc-8307-849fa4760170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:15 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827d77e9-ea88-48c0-80b9-ad26c87e19da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:15 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Volume d0b4a325-763d-4f37-a68d-20f16a10c8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb', 'volume_size': 1} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" returned: 0 in 0.505s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:15 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 1G Apr 10 18:29:15 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:15 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 1G" returned: 0 in 0.528s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:15 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:15 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:15 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:15 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:16 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.434s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:16 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 is being set with open permissions: ugo+rw Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:16 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:16 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:16 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.429s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:16 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0238f70a-4c88-44c3-ac81-4708cc17f87d tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Retype volume completed successfully. Apr 10 18:29:16 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.416s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:16 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info Apr 10 18:29:16 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:16 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:16 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:17 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info" returned: 0 in 0.427s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:17 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info is being set with open permissions: ugo+rw Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:17 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.419s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:17 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info Apr 10 18:29:17 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Acquiring lock "cinder-b400576a-e198-4ad1-b1d1-22cd63e65ed6-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "cinder-b400576a-e198-4ad1-b1d1-22cd63e65ed6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Acquiring lock "cinder-quobyte-b400576a-e198-4ad1-b1d1-22cd63e65ed6" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "cinder-quobyte-b400576a-e198-4ad1-b1d1-22cd63e65ed6" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[928ccf30-dc25-4ef5-a3dc-d66bc8f0a42c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:17 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 Apr 10 18:29:17 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:17 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.info" returned: 0 in 0.439s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-197173943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6923d539-6c53-4930-b647-3922ee4a0b82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60867283bb054feba03c8b63c1c934ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:10Z,use_quota=True,user_id='9fbec7ae9d284a3bbceb2ffa2e082fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Creating volume 6923d539-6c53-4930-b647-3922ee4a0b82 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:17 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:17 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 1073741824 Apr 10 18:29:17 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:17 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d9e11b73-8fc1-4771-b0be-3bf97f772a8f tempest-SnapshotsActionsTest-1320397494 None] Create snapshot completed successfully Apr 10 18:29:17 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:17 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6 Apr 10 18:29:17 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:18 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 1073741824" returned: 0 in 0.511s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:18 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 Apr 10 18:29:18 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:18 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b400576a-e198-4ad1-b1d1-22cd63e65ed6" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "cinder-quobyte-b400576a-e198-4ad1-b1d1-22cd63e65ed6" released by "delete_volume" :: held 0.944s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:18 devstack cinder-volume[82020]: WARNING cinder.quota [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:29:18 devstack cinder-volume[82020]: WARNING cinder.quota [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Created reservations ['7f97e43f-7a52-4f3c-a37e-9796263718ae', '5fb668d4-656b-434f-b313-e17dc76fc72a', 'bcf22e91-3df6-47eb-b571-0ef8686280f0', '75da83ae-30d7-4054-9355-b5127047d70e'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:18 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:18 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:18 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82" returned: 0 in 0.524s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1161144662',display_name='tempest-VolumesGetTest-Volume-626439068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b4a325-763d-4f37-a68d-20f16a10c8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:15Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Creating volume d0b4a325-763d-4f37-a68d-20f16a10c8bb {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:18 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:18 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb 1073741824 Apr 10 18:29:18 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48811f01-49ac-42cc-bd26-9a41a2b1a8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6923d539-6c53-4930-b647-3922ee4a0b82', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243b5c1f-ad50-4cdf-812d-00c0dc110b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:18 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Volume volume-6923d539-6c53-4930-b647-3922ee4a0b82 (6923d539-6c53-4930-b647-3922ee4a0b82): created successfully Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243b5c1f-ad50-4cdf-812d-00c0dc110b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Flow 'volume_create_manager' (f7c5f270-5ca3-40cd-90d7-53701312fb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-da263bd1-a89b-45ba-ad9b-c76af9d6daa3 tempest-VolumesListTestJSON-632128062 None] Created volume successfully. Apr 10 18:29:18 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.464s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Deleted volume successfully. Apr 10 18:29:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e530686b-4e04-4740-a826-c609778d7847 tempest-VolumeRetypeWithoutMigrationTest-455220301 None] Lock "cinder-b400576a-e198-4ad1-b1d1-22cd63e65ed6-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:19 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb 1073741824" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:19 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb Apr 10 18:29:19 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:19 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb" returned: 0 in 0.473s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.290s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Creating offline snapshot 5ed9a097-255d-46fd-b0a0-c59ef0b79a3a of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827d77e9-ea88-48c0-80b9-ad26c87e19da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a35f08-8e21-4a77-9fa3-741afd18ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88be76f-6425-47d9-a17d-476986371f88]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:19 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Volume volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb (d0b4a325-763d-4f37-a68d-20f16a10c8bb): created successfully Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a35f08-8e21-4a77-9fa3-741afd18ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (8bffb40f-f437-4b2d-9927-3c44c8f980b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-43ba010a-d380-4cfd-94ac-822566430112 tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:29:19 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:19 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Flow 'volume_create_manager' (c0f720a4-19c4-4639-b254-b1ea832a82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63294080-0dd1-4915-b5ff-d280550b63b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63294080-0dd1-4915-b5ff-d280550b63b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107336325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2546123a-0d46-4651-acba-6ba5504eb058,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60867283bb054feba03c8b63c1c934ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:20Z,use_quota=True,user_id='9fbec7ae9d284a3bbceb2ffa2e082fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26bbefe-6401-49dd-a030-4a40d8512936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26bbefe-6401-49dd-a030-4a40d8512936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6593f1-96cf-4df1-9bb6-aea9d12f5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6593f1-96cf-4df1-9bb6-aea9d12f5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2546123a-0d46-4651-acba-6ba5504eb058', 'volume_name': 'volume-2546123a-0d46-4651-acba-6ba5504eb058', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc0c643-2f8b-4b95-a847-330d60603d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc0c643-2f8b-4b95-a847-330d60603d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6045e1-6963-4170-b07c-99c3c0fa1579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:20 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Volume 2546123a-0d46-4651-acba-6ba5504eb058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2546123a-0d46-4651-acba-6ba5504eb058', 'volume_size': 1} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:20 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.578s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:20 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a 1G Apr 10 18:29:20 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-d0b4a325-763d-4f37-a68d-20f16a10c8bb-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Lock "cinder-d0b4a325-763d-4f37-a68d-20f16a10c8bb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-d0b4a325-763d-4f37-a68d-20f16a10c8bb" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-d0b4a325-763d-4f37-a68d-20f16a10c8bb" acquired by "delete_volume" :: waited 0.023s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[98465075-24e6-4d61-8074-5e091c473f87]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:20 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb Apr 10 18:29:20 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:20 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a 1G" returned: 0 in 0.555s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:20 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a Apr 10 18:29:20 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:21 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb" returned: 0 in 0.547s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:21 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb Apr 10 18:29:21 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:21 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" returned: 0 in 0.485s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:21 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a is being set with open permissions: ugo+rw Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:21 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a Apr 10 18:29:21 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:21 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d0b4a325-763d-4f37-a68d-20f16a10c8bb" returned: 0 in 0.440s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-d0b4a325-763d-4f37-a68d-20f16a10c8bb" released by "delete_volume" :: held 1.009s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Created reservations ['9e356214-32b5-4fc0-9fd9-bc6f08251e0f', '5b6e7ce2-ada8-4042-b15a-4d88c7780898', 'c8d26c56-5705-4b68-8069-6843049040ed', '241e8e59-b102-4efc-a108-3b26dde875f1'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:21 devstack sudo[87248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:21 devstack sudo[87248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:21 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107336325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2546123a-0d46-4651-acba-6ba5504eb058,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60867283bb054feba03c8b63c1c934ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:20Z,use_quota=True,user_id='9fbec7ae9d284a3bbceb2ffa2e082fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Creating volume 2546123a-0d46-4651-acba-6ba5504eb058 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:21 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:21 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 1073741824 Apr 10 18:29:21 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-605877ab-1af3-40ba-a440-63b41873b55b tempest-SnapshotsActionsTest-1320397494 None] Create snapshot completed successfully Apr 10 18:29:22 devstack sudo[87248]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:22 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a430147b-ef20-456a-aa2c-a96a7cccaa43 tempest-VolumesGetTest-59260795 None] Lock "cinder-d0b4a325-763d-4f37-a68d-20f16a10c8bb-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:22 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 1073741824" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:22 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 Apr 10 18:29:22 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-5ed9a097-255d-46fd-b0a0-c59ef0b79a3a-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-5ed9a097-255d-46fd-b0a0-c59ef0b79a3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Deleting offline snapshot 5ed9a097-255d-46fd-b0a0-c59ef0b79a3a of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] snapshot_file for this snap is: volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d1a909-fe66-476c-a4f9-c8f49d0d0295]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:22 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a Apr 10 18:29:22 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:22 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058" returned: 0 in 0.489s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Lock "cinder-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6045e1-6963-4170-b07c-99c3c0fa1579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2546123a-0d46-4651-acba-6ba5504eb058', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82995fbf-554e-446f-8041-b247fb0be5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:23 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Volume volume-2546123a-0d46-4651-acba-6ba5504eb058 (2546123a-0d46-4651-acba-6ba5504eb058): created successfully Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82995fbf-554e-446f-8041-b247fb0be5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Flow 'volume_create_manager' (c0f720a4-19c4-4639-b254-b1ea832a82cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-48ecfbec-c749-4aa5-a107-bbc053cfeab6 tempest-VolumesListTestJSON-632128062 None] Created volume successfully. Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e3bea3-1328-4ee1-b6cf-b1dd55b4c3fa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:23 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 Apr 10 18:29:23 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:23 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" returned: 0 in 0.631s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3656d9e9-5091-4ae4-b990-550322da3a8e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Flow 'volume_create_manager' (5dd413a4-aba8-4d0f-8baf-0b268602bb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:23 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:23 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c5f02f-fa44-4991-b362-a329578cce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c5f02f-fa44-4991-b362-a329578cce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-339283704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e350f8f-ea4b-43f5-8b31-f411cc37ab4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60867283bb054feba03c8b63c1c934ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:23Z,use_quota=True,user_id='9fbec7ae9d284a3bbceb2ffa2e082fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1325dec8-2298-4e63-8d17-e131f61f9f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1325dec8-2298-4e63-8d17-e131f61f9f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75c1120-cac4-48f2-a06e-f88f99e3b91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75c1120-cac4-48f2-a06e-f88f99e3b91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e350f8f-ea4b-43f5-8b31-f411cc37ab4e', 'volume_name': 'volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495636c5-784a-4d8f-bbc4-b99e3391bf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495636c5-784a-4d8f-bbc4-b99e3391bf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3021e9e3-420b-4c89-8ace-21bd2eefb1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:23 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Volume 7e350f8f-ea4b-43f5-8b31-f411cc37ab4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e', 'volume_size': 1} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-339283704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e350f8f-ea4b-43f5-8b31-f411cc37ab4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60867283bb054feba03c8b63c1c934ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:23Z,use_quota=True,user_id='9fbec7ae9d284a3bbceb2ffa2e082fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Creating volume 7e350f8f-ea4b-43f5-8b31-f411cc37ab4e {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:23 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:23 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e 1073741824 Apr 10 18:29:23 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:23 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" returned: 0 in 0.583s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:23 devstack sudo[87273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65 Apr 10 18:29:23 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:23 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.580s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:24 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a Apr 10 18:29:24 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:24 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" returned: 0 in 0.491s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65" released by "delete_volume" :: held 1.096s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:24 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e 1073741824" returned: 0 in 0.607s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:24 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e Apr 10 18:29:24 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Created reservations ['2acd1974-2554-4294-ad3d-689dda4ae0c9', '4c07440f-a864-46ff-90d0-4b5a15fbdcfa', '1ce4679d-d02a-4ec5-bd9c-a8455d9cdfe3', '92984187-be33-4801-ad95-83b1c5550b9e'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:24 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:24 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:24 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" returned: 0 in 0.587s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:24 devstack sudo[87292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a Apr 10 18:29:24 devstack sudo[87292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:24 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Flow 'volume_create_manager' (18c81be6-19dc-4d75-9043-9327a3e2b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b7644c-e3e3-4fc9-8edb-e1f6e3f0637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:24 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b7644c-e3e3-4fc9-8edb-e1f6e3f0637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1799561863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7196162f-75a1-4982-9ad4-83c6f88f4087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0fc40a3314405da382c837554d64bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:25Z,use_quota=True,user_id='97d96d3f6f2c4e82bb6939c40651b505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0629892-0882-428b-976e-57efc7343851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0629892-0882-428b-976e-57efc7343851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a788b5b6-1416-4f58-b373-d3091942e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a788b5b6-1416-4f58-b373-d3091942e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7196162f-75a1-4982-9ad4-83c6f88f4087', 'volume_name': 'volume-7196162f-75a1-4982-9ad4-83c6f88f4087', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6832883b-2ae2-4043-8301-b9dfd5269b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6832883b-2ae2-4043-8301-b9dfd5269b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f473fa6-0a7a-45a7-8294-dd161fdbf0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Volume 7196162f-75a1-4982-9ad4-83c6f88f4087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7196162f-75a1-4982-9ad4-83c6f88f4087', 'volume_size': 1} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e" returned: 0 in 0.612s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.537s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1799561863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7196162f-75a1-4982-9ad4-83c6f88f4087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0fc40a3314405da382c837554d64bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:25Z,use_quota=True,user_id='97d96d3f6f2c4e82bb6939c40651b505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Creating volume 7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:24 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:24 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3021e9e3-420b-4c89-8ace-21bd2eefb1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:24 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 1073741824 Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28654cb3-614a-4407-b1a9-c8c2b441cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:24 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6720a291-98ad-4686-836e-12a03b83838d tempest-VolumesGetTest-59260795 None] Lock "cinder-2b5ebf6b-a8bd-44af-a1dd-83c1ba04bd65-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Volume volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e (7e350f8f-ea4b-43f5-8b31-f411cc37ab4e): created successfully Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28654cb3-614a-4407-b1a9-c8c2b441cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Flow 'volume_create_manager' (5dd413a4-aba8-4d0f-8baf-0b268602bb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:24 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ef7c69ec-ebc1-43ee-8638-4679f607b7a2 tempest-VolumesListTestJSON-632128062 None] Created volume successfully. Apr 10 18:29:25 devstack sudo[87292]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-5ed9a097-255d-46fd-b0a0-c59ef0b79a3a" released by "_delete_snapshot" :: held 2.320s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" released by "delete_snapshot" :: held 2.330s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Created reservations ['d34608cc-4c57-4855-baa4-f0ab615b602e', '32f38ca9-55e2-427e-a5cc-44bf83bf9b07', '7ab91744-bf18-4177-b7e5-3cb61bcbb7ef', '2401a25a-b03b-4790-9e44-4f0698640167'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Delete snapshot completed successfully. Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-daa65d5d-d2b3-4c32-af08-64e321c97cad tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-5ed9a097-255d-46fd-b0a0-c59ef0b79a3a-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-8d250334-e35e-468b-8e5f-ea293c8e878b-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Lock "cinder-8d250334-e35e-468b-8e5f-ea293c8e878b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-8d250334-e35e-468b-8e5f-ea293c8e878b" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-8d250334-e35e-468b-8e5f-ea293c8e878b" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815e161-6c95-4453-a90e-ab240e82baf1]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:25 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:25 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:25 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 1073741824" returned: 0 in 0.556s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:25 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 Apr 10 18:29:25 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:25 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.551s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:25 devstack sudo[87309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b Apr 10 18:29:25 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:25 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087" returned: 0 in 0.479s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f473fa6-0a7a-45a7-8294-dd161fdbf0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7196162f-75a1-4982-9ad4-83c6f88f4087', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549954d3-947a-4b97-8d86-0ef04bd1d8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:25 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Volume volume-7196162f-75a1-4982-9ad4-83c6f88f4087 (7196162f-75a1-4982-9ad4-83c6f88f4087): created successfully Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549954d3-947a-4b97-8d86-0ef04bd1d8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Flow 'volume_create_manager' (18c81be6-19dc-4d75-9043-9327a3e2b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-165f6d28-b024-48f9-9a2d-3dff0d73ae6c tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Created volume successfully. Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Creating offline snapshot 08041b6b-f8dc-4bab-8907-4cf495fc859b of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f54f6-6da2-4df0-8464-d1dabd3461d1]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:26 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:26 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:26 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8d250334-e35e-468b-8e5f-ea293c8e878b" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-8d250334-e35e-468b-8e5f-ea293c8e878b" released by "delete_volume" :: held 1.025s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Created reservations ['511f9bd2-c55e-446f-b32f-ff2ee3b5b2da', '47fb102a-606d-4924-9997-3c52947923c3', '6392e0fa-a629-43dd-883f-8ba49481fca1', '64688e39-5301-4dd9-8933-919939e019cc'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:26 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:26 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:26 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.512s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:26 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b 1G Apr 10 18:29:26 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:26 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.463s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:26 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ad9e2467-303f-4340-9283-e8938e3296e7 tempest-VolumesGetTest-59260795 None] Lock "cinder-8d250334-e35e-468b-8e5f-ea293c8e878b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:27 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b 1G" returned: 0 in 0.570s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:27 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b Apr 10 18:29:27 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "cinder-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "cinder-quobyte-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-quobyte-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced124f5-47fd-46ee-9e24-758b73d2be07]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:27 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e Apr 10 18:29:27 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:27 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b" returned: 0 in 0.463s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:27 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b is being set with open permissions: ugo+rw Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:27 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b Apr 10 18:29:27 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (759b8521-2bf8-4a16-8b6b-86edc50362e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedf3ece-d6dd-43af-95f0-6179bd0f8e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedf3ece-d6dd-43af-95f0-6179bd0f8e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1605571078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903a5a8e-afc2-497c-b500-72a36e8c1ad8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:28Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf56efd-56f3-4bc2-a929-ec37254f3ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf56efd-56f3-4bc2-a929-ec37254f3ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed27589-45fa-4742-819e-74e2f21dd5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG cinder.image.glance [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Creating Keystone auth plugin from conf {{(pid=82020) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 18:29:27 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:27 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e Apr 10 18:29:27 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed27589-45fa-4742-819e-74e2f21dd5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '903a5a8e-afc2-497c-b500-72a36e8c1ad8', 'volume_name': 'volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1aec90-3a9b-42f1-b2bc-8bd4a8ecc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1aec90-3a9b-42f1-b2bc-8bd4a8ecc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38328e4-20b4-4b24-a857-24b01dfd95e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:28 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Volume 903a5a8e-afc2-497c-b500-72a36e8c1ad8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Trying to clone 903a5a8e-afc2-497c-b500-72a36e8c1ad8 from image efad70a4-2f7f-4812-890b-f0ef460d14cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]). {{(pid=82020) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 18:29:28 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.204s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Creating offline snapshot e8f90356-294a-4d91-afef-b4bc1fce7b0b of volume 7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac159b43-d64a-45b4-b7d5-a2c72628c055]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d5c3af5f-2000-450c-8ec9-a981f1c0508b tempest-SnapshotsActionsTest-1320397494 None] Create snapshot completed successfully Apr 10 18:29:28 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 Apr 10 18:29:28 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 18:29:28 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Image download 20.69 MB at 20.69 MB/s Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7f9857-3db4-4790-9d75-5d546bb7cf00]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:28 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e" returned: 0 in 0.434s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-quobyte-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e" released by "delete_volume" :: held 0.969s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:28 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD Apr 10 18:29:28 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Created reservations ['e1b58986-fa65-4c1f-b344-ed14c0eb7d1f', '0456a02e-4c19-4ad2-9f13-91da0d095af8', '4442ccb5-dfaa-401b-808a-14a93abf6fe7', '85235ebe-bf63-4aa5-b886-2e688468623d'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:28 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:28 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:28 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:28 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b 1G Apr 10 18:29:28 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:28 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf is fetched for user dfeb5fdbec8049e59d3a504768c920ec. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4ff77-5e60-48f3-88d6-5bca1d3c06f9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:28 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD Apr 10 18:29:28 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:28 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.437s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Deleted volume successfully. Apr 10 18:29:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1dac0d7c-fd18-4d6f-9e60-d7215170b2c1 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-7e350f8f-ea4b-43f5-8b31-f411cc37ab4e-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-08041b6b-f8dc-4bab-8907-4cf495fc859b-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-08041b6b-f8dc-4bab-8907-4cf495fc859b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-08041b6b-f8dc-4bab-8907-4cf495fc859b" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-08041b6b-f8dc-4bab-8907-4cf495fc859b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Deleting offline snapshot 08041b6b-f8dc-4bab-8907-4cf495fc859b of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] snapshot_file for this snap is: volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac33804-4607-4c7d-9f54-5d71eafdaf3e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:29 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b 1G" returned: 0 in 0.587s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7196162f-75a1-4982-9ad4-83c6f88f4087 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:29 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7196162f-75a1-4982-9ad4-83c6f88f4087 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b Apr 10 18:29:29 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:29 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b Apr 10 18:29:29 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:29 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "cinder-2546123a-0d46-4651-acba-6ba5504eb058-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-2546123a-0d46-4651-acba-6ba5504eb058-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "cinder-quobyte-2546123a-0d46-4651-acba-6ba5504eb058" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-quobyte-2546123a-0d46-4651-acba-6ba5504eb058" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9186f1a-c01b-4be2-8c43-a7c38608d2d8]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:29 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 Apr 10 18:29:29 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:29 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7196162f-75a1-4982-9ad4-83c6f88f4087 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b" returned: 0 in 0.472s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:29 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b is being set with open permissions: ugo+rw Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:29 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:29 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b Apr 10 18:29:29 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bd71c1-b797-4b03-91fc-7129a6750097]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:29 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:29 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058" returned: 0 in 0.501s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058 Apr 10 18:29:30 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b" returned: 0 in 0.428s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info Apr 10 18:29:30 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b Apr 10 18:29:30 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2546123a-0d46-4651-acba-6ba5504eb058" returned: 0 in 0.426s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-quobyte-2546123a-0d46-4651-acba-6ba5504eb058" released by "delete_volume" :: held 0.952s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Created reservations ['2de9fef3-aef1-48e3-a9ca-229560a89602', 'aced0be1-082b-420b-a9c2-cd4689e7aba8', '2727a89f-7ac5-4349-9295-ecb0a585b097', 'b1bf0b88-c6d1-41b0-96c9-ffe5b9975a66'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:30 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info" returned: 0 in 0.424s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:30 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info is being set with open permissions: ugo+rw Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info Apr 10 18:29:30 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:30 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "cinder-6923d539-6c53-4930-b647-3922ee4a0b82-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:30 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b Apr 10 18:29:30 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-6923d539-6c53-4930-b647-3922ee4a0b82-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "cinder-quobyte-6923d539-6c53-4930-b647-3922ee4a0b82" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-quobyte-6923d539-6c53-4930-b647-3922ee4a0b82" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3536a395-8956-499e-9989-584c3d381098]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:30 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 Apr 10 18:29:30 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:31 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.info" returned: 0 in 0.447s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1605571078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903a5a8e-afc2-497c-b500-72a36e8c1ad8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:28Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Creating volume 903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:31 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-10b3c76d-ace7-41cb-841e-4632211c4449 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Create snapshot completed successfully Apr 10 18:29:31 devstack sudo[87414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 1073741824 Apr 10 18:29:31 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:31 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.518s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Deleted volume successfully. Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0e0fae5a-098b-471f-b6c0-e26e07375407 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-2546123a-0d46-4651-acba-6ba5504eb058-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:31 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.08041b6b-f8dc-4bab-8907-4cf495fc859b" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-08041b6b-f8dc-4bab-8907-4cf495fc859b" released by "_delete_snapshot" :: held 2.042s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" released by "delete_snapshot" :: held 2.054s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Created reservations ['25c0c423-5287-44b0-9c57-27b3076a881b', 'fd721ccd-cc20-4dd5-bc18-bfab69dbc63a', 'f7570eda-1494-4787-ab18-057392ec3637', 'b0e78e9b-883b-40e9-bb37-425240bbe822'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Delete snapshot completed successfully. Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3f44e316-7d7d-41e8-8714-ddad4fb9ab40 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-08041b6b-f8dc-4bab-8907-4cf495fc859b-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:31 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82" returned: 0 in 0.531s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:31 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82 Apr 10 18:29:31 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:31 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 1073741824" returned: 0 in 0.568s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:31 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:31 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:31 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6923d539-6c53-4930-b647-3922ee4a0b82" returned: 0 in 0.412s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-quobyte-6923d539-6c53-4930-b647-3922ee4a0b82" released by "delete_volume" :: held 0.976s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Created reservations ['35565b24-1430-416b-b52b-addf2c46ff28', '07a6d12d-868f-4b8a-8532-d533ce465fc4', 'd1f1eac8-96b6-4fc0-a84f-9526db966feb', 'd95ae499-26b0-42a3-9d29-ffcac09fd6d5'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:31 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:31 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:32 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 0 in 0.478s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Attempting download of efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume 903a5a8e-afc2-497c-b500-72a36e8c1ad8. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80837a1-b5fe-4272-ad28-bb539e6ae93d]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:32 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.454s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:32 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Deleted volume successfully. Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6a04a713-c270-47a2-ab1d-8d28d6c369d7 tempest-VolumesListTestJSON-632128062 None] Lock "cinder-6923d539-6c53-4930-b647-3922ee4a0b82-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:32 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c Apr 10 18:29:32 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "cinder-e8f90356-294a-4d91-afef-b4bc1fce7b0b-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-e8f90356-294a-4d91-afef-b4bc1fce7b0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "cinder-quobyte-7196162f-75a1-4982-9ad4-83c6f88f4087" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-quobyte-7196162f-75a1-4982-9ad4-83c6f88f4087" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "cinder-quobyte-e8f90356-294a-4d91-afef-b4bc1fce7b0b" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-quobyte-e8f90356-294a-4d91-afef-b4bc1fce7b0b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Deleting offline snapshot e8f90356-294a-4d91-afef-b4bc1fce7b0b of volume 7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] snapshot_file for this snap is: volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd03859-a79d-4efb-a086-8640e56a65e7]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:32 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b Apr 10 18:29:32 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Creating offline snapshot ecd964e1-0311-428a-8d12-60d74eb0de4a of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce981b4b-c339-43ec-b1f3-e1f0aaad5fd9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:32 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:32 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:32 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c" returned: 0 in 0.704s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:33 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c Apr 10 18:29:33 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:33 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b" returned: 0 in 0.608s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7196162f-75a1-4982-9ad4-83c6f88f4087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[26080dd2-1cd3-44a7-9419-392c5e4c1dfc]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:33 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 Apr 10 18:29:33 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:33 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.569s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:33 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a 1G Apr 10 18:29:33 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:33 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c" returned: 1 in 0.488s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_y52fqg4c' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0c0fa1-3566-4659-9884-82bf884adf33]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:33 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD Apr 10 18:29:33 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:33 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087" returned: 0 in 0.581s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:33 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b Apr 10 18:29:33 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:33 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a 1G" returned: 0 in 0.635s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:34 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a Apr 10 18:29:34 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:34 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD" returned: 0 in 0.603s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] efad70a4-2f7f-4812-890b-f0ef460d14cf was qcow2, converting to raw {{(pid=82020) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:34 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:34 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:34 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b" returned: 0 in 0.618s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:34 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b Apr 10 18:29:34 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:34 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:34 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a is being set with open permissions: ugo+rw Apr 10 18:29:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:34 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a Apr 10 18:29:34 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:34 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087.e8f90356-294a-4d91-afef-b4bc1fce7b0b" returned: 0 in 0.574s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-quobyte-e8f90356-294a-4d91-afef-b4bc1fce7b0b" released by "_delete_snapshot" :: held 2.450s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:35 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-quobyte-7196162f-75a1-4982-9ad4-83c6f88f4087" released by "delete_snapshot" :: held 2.464s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a" returned: 0 in 0.544s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Created reservations ['8dd21764-961e-4c58-bfa6-d3ee2a473d3c', 'b756fee3-a813-4827-b472-c1f5f56f3b7b', 'a54eabba-db04-4a07-8c0c-3ff587fb91dc', '6fdfcbb0-e5a3-4638-9038-400e214ae591'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-66cd5e85-b1b0-4659-a2d2-3a24e2d5591b tempest-SnapshotsActionsTest-1320397494 None] Create snapshot completed successfully Apr 10 18:29:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Delete snapshot completed successfully. Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0eea0fad-cf8b-45fe-b3b2-1160d4461dc9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-e8f90356-294a-4d91-afef-b4bc1fce7b0b-delete_snapshot" released by "delete_snapshot" :: held 2.576s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:35 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 0 in 1.104s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_zvcq8k86devstack@QuobyteHD, size 112.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:29:35 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Converted 112.00 MB image at 101.36 MB/s Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:35 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 1G Apr 10 18:29:35 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:35 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 1G" returned: 0 in 0.454s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[507b272b-5bbc-4e80-834c-5a9a52eb0a33]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:35 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:35 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "cinder-7196162f-75a1-4982-9ad4-83c6f88f4087-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-7196162f-75a1-4982-9ad4-83c6f88f4087-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "cinder-quobyte-7196162f-75a1-4982-9ad4-83c6f88f4087" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-quobyte-7196162f-75a1-4982-9ad4-83c6f88f4087" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e047130c-7a39-4dfe-9010-72a9eb582987]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-ecd964e1-0311-428a-8d12-60d74eb0de4a-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-ecd964e1-0311-428a-8d12-60d74eb0de4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-ecd964e1-0311-428a-8d12-60d74eb0de4a" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-ecd964e1-0311-428a-8d12-60d74eb0de4a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Deleting offline snapshot ecd964e1-0311-428a-8d12-60d74eb0de4a of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:36 devstack sudo[87497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 Apr 10 18:29:36 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] snapshot_file for this snap is: volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e672d02-74b2-4cf3-82f1-44e998a44e70]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:36 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a Apr 10 18:29:36 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:36 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 0 in 0.626s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:36 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:36 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:36 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087" returned: 0 in 0.508s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:36 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087 Apr 10 18:29:36 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:36 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a" returned: 0 in 0.602s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b2bf4f-13eb-4866-af45-f4355148a799]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:36 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:36 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:36 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 1 in 0.650s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Downloaded image efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume 903a5a8e-afc2-497c-b500-72a36e8c1ad8 successfully. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf for user dfeb5fdbec8049e59d3a504768c920ec is deleted. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Marking volume 903a5a8e-afc2-497c-b500-72a36e8c1ad8 as bootable. {{(pid=82020) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Copying metadata from image efad70a4-2f7f-4812-890b-f0ef460d14cf to 903a5a8e-afc2-497c-b500-72a36e8c1ad8. {{(pid=82020) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 18:29:36 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Creating volume glance metadata for volume 903a5a8e-afc2-497c-b500-72a36e8c1ad8 backed by image efad70a4-2f7f-4812-890b-f0ef460d14cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82020) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38328e4-20b4-4b24-a857-24b01dfd95e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f18ddf-71ab-4ca0-970a-611ddb1316dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:37 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Volume volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 (903a5a8e-afc2-497c-b500-72a36e8c1ad8): created successfully Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1f18ddf-71ab-4ca0-970a-611ddb1316dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (759b8521-2bf8-4a16-8b6b-86edc50362e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:37 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-505e8a51-698a-4fc0-857c-d5abc359ef43 tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:29:37 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7196162f-75a1-4982-9ad4-83c6f88f4087" returned: 0 in 0.770s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-quobyte-7196162f-75a1-4982-9ad4-83c6f88f4087" released by "delete_volume" :: held 1.321s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Created reservations ['3921c8be-1287-4878-aaec-cb4b0d752591', '49c1b662-3396-467d-bffe-37a4ad5c3962', '52748efe-11fd-429f-b974-2e748d27c072', '32e75a70-ccf2-4334-9808-941ae6208b0e'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:37 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:37 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:37 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.759s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:37 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a Apr 10 18:29:37 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:37 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.567s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:37 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Deleted volume successfully. Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6e53dee9-516b-4ac5-a0d8-50c639c858b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1171294244 None] Lock "cinder-7196162f-75a1-4982-9ad4-83c6f88f4087-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (21d4e367-3d38-4ffb-aa32-0dc8782a52e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792d4259-fcad-4ced-ae75-fae276595875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792d4259-fcad-4ced-ae75-fae276595875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2012607434',display_name='tempest-VolumesGetTest-Volume-1634008372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09560e8-41a2-4190-998d-af78486b7e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:38Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3839aff-819b-4587-8d55-4d111d5bcdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3839aff-819b-4587-8d55-4d111d5bcdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da99799-005b-4198-824a-df4fcc576c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da99799-005b-4198-824a-df4fcc576c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09560e8-41a2-4190-998d-af78486b7e54', 'volume_name': 'volume-d09560e8-41a2-4190-998d-af78486b7e54', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cefb42-b42c-47ec-9b1a-ca3c3dfe54f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cefb42-b42c-47ec-9b1a-ca3c3dfe54f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af2d91e-77b7-4e2c-8b48-75fdec343384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:37 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Volume d09560e8-41a2-4190-998d-af78486b7e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09560e8-41a2-4190-998d-af78486b7e54', 'volume_size': 1} Apr 10 18:29:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2012607434',display_name='tempest-VolumesGetTest-Volume-1634008372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09560e8-41a2-4190-998d-af78486b7e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5edb362a97a40f784fa490256b40a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:38Z,use_quota=True,user_id='dfeb5fdbec8049e59d3a504768c920ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Creating volume d09560e8-41a2-4190-998d-af78486b7e54 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:38 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:38 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a" returned: 0 in 0.621s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:38 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 1073741824 Apr 10 18:29:38 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:38 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a Apr 10 18:29:38 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:38 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.ecd964e1-0311-428a-8d12-60d74eb0de4a" returned: 0 in 0.527s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-ecd964e1-0311-428a-8d12-60d74eb0de4a" released by "_delete_snapshot" :: held 2.562s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" released by "delete_snapshot" :: held 2.574s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Created reservations ['ba48b8b4-aeaf-45cc-b254-d8394883a076', '32537384-8c9f-4cc8-ab4c-690c1a376293', '79a3cb71-77fa-4370-a9bc-1b72c0f0fc35', 'cfd184ca-991e-49b0-ac30-cca6aebde95b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:38 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 1073741824" returned: 0 in 0.609s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:38 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Delete snapshot completed successfully. Apr 10 18:29:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24f6bf83-1649-4bef-9cf9-22637054982d tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-ecd964e1-0311-428a-8d12-60d74eb0de4a-delete_snapshot" released by "delete_snapshot" :: held 2.694s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:38 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 Apr 10 18:29:38 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:39 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54" returned: 0 in 0.528s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af2d91e-77b7-4e2c-8b48-75fdec343384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09560e8-41a2-4190-998d-af78486b7e54', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57357af-2f71-42bd-bfd9-5dcc40e12785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:39 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Volume volume-d09560e8-41a2-4190-998d-af78486b7e54 (d09560e8-41a2-4190-998d-af78486b7e54): created successfully Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57357af-2f71-42bd-bfd9-5dcc40e12785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Flow 'volume_create_manager' (21d4e367-3d38-4ffb-aa32-0dc8782a52e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:39 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a2488cd8-c66d-4766-8408-676d5313f7c7 tempest-VolumesGetTest-59260795 None] Created volume successfully. Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Creating offline snapshot c88457b2-8ad5-4f59-82e6-a50a921806d9 of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e687cb61-481f-49c6-992b-f870bd0e3a7d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:39 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:39 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:40 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.588s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:40 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 1G Apr 10 18:29:40 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-d09560e8-41a2-4190-998d-af78486b7e54-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Lock "cinder-d09560e8-41a2-4190-998d-af78486b7e54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-d09560e8-41a2-4190-998d-af78486b7e54" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-d09560e8-41a2-4190-998d-af78486b7e54" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9d323-1e9e-4e87-bfdb-9856966cbb22]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:40 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 Apr 10 18:29:40 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:40 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 1G" returned: 0 in 0.624s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:40 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 Apr 10 18:29:40 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:40 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54" returned: 0 in 0.694s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:40 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54 Apr 10 18:29:40 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:41 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9" returned: 0 in 0.535s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:41 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 is being set with open permissions: ugo+rw Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:41 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 Apr 10 18:29:41 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:41 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d09560e8-41a2-4190-998d-af78486b7e54" returned: 0 in 0.565s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-d09560e8-41a2-4190-998d-af78486b7e54" released by "delete_volume" :: held 1.288s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Created reservations ['dd880845-a943-49f2-a54a-072fbdea13f1', '92cabcca-6da4-48fe-b5b0-186f929837ba', '315e07dd-4e5b-4bed-ae9a-a1e0bddd4a92', '55bfaf82-f858-4d7f-86f0-5c041bece491'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:41 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:41 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:41 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9" returned: 0 in 0.524s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:41 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5423130a-a293-401d-8cd1-ce3f6f17981e tempest-SnapshotsActionsTest-1320397494 None] Create snapshot completed successfully Apr 10 18:29:42 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.592s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:42 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-66518c36-3f9d-441d-957d-b2de45a654e0 tempest-VolumesGetTest-59260795 None] Lock "cinder-d09560e8-41a2-4190-998d-af78486b7e54-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-903a5a8e-afc2-497c-b500-72a36e8c1ad8-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Flow 'volume_create_manager' (ad3cb4e8-e1ec-4516-a0fe-5c6cff7b3081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e27fa3-2f3f-4349-ae5d-66a7c0a7a924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Lock "cinder-903a5a8e-afc2-497c-b500-72a36e8c1ad8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e27fa3-2f3f-4349-ae5d-66a7c0a7a924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-468175713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ba6a6c-2f9e-495a-bcde-dfd9bee35adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02f3789ee394bc585628808d607a7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:42Z,use_quota=True,user_id='6417d29c1cd64f97966971fdabd057ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c660b271-29c1-4a4a-9fde-60b59e0c78bb),volume_type_id=c660b271-29c1-4a4a-9fde-60b59e0c78bb)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f52ff4-b98e-4d2e-851e-5d5a96840bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f52ff4-b98e-4d2e-851e-5d5a96840bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26eaffd3-29a5-4ffb-abd9-162d8ff80990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26eaffd3-29a5-4ffb-abd9-162d8ff80990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82ba6a6c-2f9e-495a-bcde-dfd9bee35adc', 'volume_name': 'volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d089e1-1d63-4c6c-b85e-bb67908cf101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d089e1-1d63-4c6c-b85e-bb67908cf101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106c8ec-cdce-4bc8-a641-7ea1a953ff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:42 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Volume 82ba6a6c-2f9e-495a-bcde-dfd9bee35adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc', 'volume_size': 1} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-468175713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82ba6a6c-2f9e-495a-bcde-dfd9bee35adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d02f3789ee394bc585628808d607a7bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:42Z,use_quota=True,user_id='6417d29c1cd64f97966971fdabd057ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c660b271-29c1-4a4a-9fde-60b59e0c78bb),volume_type_id=c660b271-29c1-4a4a-9fde-60b59e0c78bb)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Creating volume 82ba6a6c-2f9e-495a-bcde-dfd9bee35adc {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:42 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:42 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc 1073741824 Apr 10 18:29:42 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Acquiring lock "cinder-quobyte-903a5a8e-afc2-497c-b500-72a36e8c1ad8" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-903a5a8e-afc2-497c-b500-72a36e8c1ad8" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a498c-c92a-4c67-a169-a4cd84c1f58f]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-c88457b2-8ad5-4f59-82e6-a50a921806d9-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-c88457b2-8ad5-4f59-82e6-a50a921806d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Acquiring lock "cinder-quobyte-c88457b2-8ad5-4f59-82e6-a50a921806d9" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-c88457b2-8ad5-4f59-82e6-a50a921806d9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Deleting offline snapshot c88457b2-8ad5-4f59-82e6-a50a921806d9 of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] snapshot_file for this snap is: volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06f1d1-45ac-4c6d-b38d-78dfe2281018]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:42 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:42 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:42 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 Apr 10 18:29:42 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:43 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc 1073741824" returned: 0 in 0.636s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:43 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc Apr 10 18:29:43 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:43 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 0 in 0.604s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:43 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9" returned: 0 in 0.573s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3839483a-a07f-47ae-aed1-b010c9a1ad43]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:43 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:43 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:43 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:43 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:43 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc" returned: 0 in 0.532s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a106c8ec-cdce-4bc8-a641-7ea1a953ff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2825a8-624c-4ae9-99ea-c595230927a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:43 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Volume volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc (82ba6a6c-2f9e-495a-bcde-dfd9bee35adc): created successfully Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2825a8-624c-4ae9-99ea-c595230927a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Flow 'volume_create_manager' (ad3cb4e8-e1ec-4516-a0fe-5c6cff7b3081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:43 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8edfbf07-f249-47ab-8fab-2afba0c0cbbb tempest-VolumeTypesAccessTest-202051916 None] Created volume successfully. Apr 10 18:29:43 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 1 in 0.609s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:43 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:43 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8 Apr 10 18:29:43 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.566s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:43 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 Apr 10 18:29:43 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:44 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-903a5a8e-afc2-497c-b500-72a36e8c1ad8" returned: 0 in 0.451s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Lock "cinder-quobyte-903a5a8e-afc2-497c-b500-72a36e8c1ad8" released by "delete_volume" :: held 1.715s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Created reservations ['7f6bdf63-106f-4960-abd2-895ac08f2f6a', '47d3e2c4-a2ab-4f87-82a9-e19f3bdc9ccd', 'b5728bcd-c352-4a86-afe1-db0b6515e7c4', '6e1586bd-7f3f-48f1-aa3a-c43cdcfdd198'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:44 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9" returned: 0 in 0.491s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:44 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9 Apr 10 18:29:44 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:44 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:44 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Acquiring lock "cinder-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Lock "cinder-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Acquiring lock "cinder-quobyte-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Lock "cinder-quobyte-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc" acquired by "delete_volume" :: waited 0.022s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf33756b-86fc-42d0-b726-84cc7337758d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:44 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.c88457b2-8ad5-4f59-82e6-a50a921806d9" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-c88457b2-8ad5-4f59-82e6-a50a921806d9" released by "_delete_snapshot" :: held 2.160s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" released by "delete_snapshot" :: held 2.175s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:44 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc Apr 10 18:29:44 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Created reservations ['bb0cb204-1163-429f-a133-41e76bb0b4c0', '5f46f052-deaf-4608-bd54-e45263517985', 'ba7479d0-ce42-4667-8e10-6a676a44b486', '1085ef91-ea5c-485e-bb97-7b3cb985921b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:44 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.600s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:44 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Deleted volume successfully. Apr 10 18:29:44 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Delete snapshot completed successfully. Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-902285b9-0b61-4482-b5dd-086905072871 tempest-SnapshotsActionsTest-2139858020 None] Lock "cinder-c88457b2-8ad5-4f59-82e6-a50a921806d9-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:44 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2296d11e-536f-4f45-897c-28164aac7a91 tempest-VolumesGetTest-59260795 None] Lock "cinder-903a5a8e-afc2-497c-b500-72a36e8c1ad8-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:45 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc" returned: 0 in 0.606s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:45 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc Apr 10 18:29:45 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:45 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc" returned: 0 in 0.582s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Lock "cinder-quobyte-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc" released by "delete_volume" :: held 1.214s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:45 devstack cinder-volume[82020]: WARNING cinder.quota [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-991419071 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-991419071, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:29:45 devstack cinder-volume[82020]: WARNING cinder.quota [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-991419071 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-991419071, it is now deprecated. Please use the default quota class for default quota. Apr 10 18:29:45 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Created reservations ['647e4448-c87c-4f66-9964-678d70ea499a', '90489844-a7c6-46fc-a032-a12facea3ef7', 'c749a081-db20-4115-9d5f-c04c45486b71', '822d17b9-633c-4b1d-91a1-fdcf0dea0de5'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:46 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:46 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "cinder-251b8a6d-43b5-4f77-ac47-c6c96484add6-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-251b8a6d-43b5-4f77-ac47-c6c96484add6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "cinder-quobyte-251b8a6d-43b5-4f77-ac47-c6c96484add6" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-quobyte-251b8a6d-43b5-4f77-ac47-c6c96484add6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Deleting offline snapshot 251b8a6d-43b5-4f77-ac47-c6c96484add6 of volume 7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] snapshot_file for this snap is: volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9993fb49-175b-4e9f-9664-0f63e14ea43a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:46 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:46 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:46 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.560s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:46 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Deleted volume successfully. Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7f99722-9ee6-468a-9268-abe1dea53a4f tempest-VolumeTypesAccessTest-202051916 None] Lock "cinder-82ba6a6c-2f9e-495a-bcde-dfd9bee35adc-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:46 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.520s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4009256-cbf5-4e59-8c08-809ae0098c74]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:46 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f Apr 10 18:29:46 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:47 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" returned: 0 in 0.715s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:47 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:47 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:47 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.533s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:48 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6 Apr 10 18:29:48 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:48 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f.251b8a6d-43b5-4f77-ac47-c6c96484add6" returned: 0 in 0.685s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:UPDATE=274,cinder:SELECT=219,cinder:DELETE=25,cinder:INSERT=61 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:UPDATE=289,cinder:SELECT=220,cinder:INSERT=83,cinder:DELETE=18 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-quobyte-251b8a6d-43b5-4f77-ac47-c6c96484add6" released by "_delete_snapshot" :: held 2.591s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" released by "delete_snapshot" :: held 2.608s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Created reservations ['6a5e5557-daf2-41b7-a025-f199a2514faf', '5cfbf89e-3385-4d6d-908a-c5a6cd3d9bef', 'fe07b0ac-8ab2-490e-b364-260fc5542adb', '25b3757b-86ce-4d8b-b080-f9f30d2b4e16'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Delete snapshot completed successfully. Apr 10 18:29:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-2c84a958-9bf0-4fa9-ac0d-662b41d1aa14 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-251b8a6d-43b5-4f77-ac47-c6c96484add6-delete_snapshot" released by "delete_snapshot" :: held 2.779s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "cinder-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" acquired by "delete_volume" :: waited 0.017s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:49 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[00196b2c-f8ac-4dfd-87d2-665f76bcae73]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:49 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f Apr 10 18:29:49 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:50 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" returned: 0 in 0.614s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:50 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f Apr 10 18:29:50 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:50 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" returned: 0 in 0.588s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-quobyte-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f" released by "delete_volume" :: held 1.238s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Flow 'volume_create_manager' (7c877600-0238-455b-9bd2-3ab9f321eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0381d0-9d61-496d-b53d-cc352180bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Created reservations ['cc598dd9-92ad-4de4-8aad-f531db4fd35b', '6d810701-869f-4ac5-84be-05a584e264d0', 'dac94eb7-615b-418e-9841-30daaaa539a7', 'ab306ec4-7281-410f-9a2e-c4adda49cee0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0381d0-9d61-496d-b53d-cc352180bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1295790777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af15b7c2-d743-435a-80d7-8b4576e2c6ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6e4948d34981b31e92ee79523709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:51Z,use_quota=True,user_id='7c559faca7c043329b68564fda47ce53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650ac57d-f036-4afb-a26e-e7ffd1b08fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650ac57d-f036-4afb-a26e-e7ffd1b08fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daac9e5-23eb-4a77-a330-a0bc9cec9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5daac9e5-23eb-4a77-a330-a0bc9cec9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af15b7c2-d743-435a-80d7-8b4576e2c6ec', 'volume_name': 'volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ca4b6d-f717-4c15-829f-15f4bd243bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ca4b6d-f717-4c15-829f-15f4bd243bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4118c41b-764b-4e3d-988b-2f968fde5123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:50 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Volume af15b7c2-d743-435a-80d7-8b4576e2c6ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec', 'volume_size': 1} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1295790777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af15b7c2-d743-435a-80d7-8b4576e2c6ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6e4948d34981b31e92ee79523709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:51Z,use_quota=True,user_id='7c559faca7c043329b68564fda47ce53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Creating volume af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:50 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:50 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec 1073741824 Apr 10 18:29:50 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:50 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:29:50 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:51 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.530s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:51 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:29:51 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Deleted volume successfully. Apr 10 18:29:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26cda275-6b93-4d61-8c6f-438072812ab3 tempest-SnapshotsActionsTest-1320397494 None] Lock "cinder-7fd4112b-8aff-4be4-8ec1-f9ea4ea8980f-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:29:51 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec 1073741824" returned: 0 in 0.731s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:51 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:29:51 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:52 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.524s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4118c41b-764b-4e3d-988b-2f968fde5123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ee8114-bae7-425f-a2f6-bdd5544e8e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:52 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Volume volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec (af15b7c2-d743-435a-80d7-8b4576e2c6ec): created successfully Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ee8114-bae7-425f-a2f6-bdd5544e8e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Flow 'volume_create_manager' (7c877600-0238-455b-9bd2-3ab9f321eabb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-32adf57f-0a27-456d-a91b-3572a2faf1cd tempest-SnapshotDependencyTests-1055191610 None] Created volume successfully. Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Creating offline snapshot 0467282a-938f-41ea-9d5d-63d1de864901 of volume af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b685b9-e88b-4286-b8c1-46c64fda12a2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:53 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:29:53 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:53 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.614s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:53 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 1G Apr 10 18:29:53 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:54 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 1G" returned: 0 in 0.655s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:54 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 Apr 10 18:29:54 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:54 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901" returned: 0 in 0.608s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:54 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 is being set with open permissions: ugo+rw Apr 10 18:29:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:55 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 Apr 10 18:29:55 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:55 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901" returned: 0 in 0.752s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:55 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info Apr 10 18:29:55 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:56 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info" returned: 0 in 0.737s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:56 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info is being set with open permissions: ugo+rw Apr 10 18:29:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:56 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info Apr 10 18:29:56 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:57 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.info" returned: 0 in 0.581s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.050s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:57 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-85691e9f-ca64-4a94-8d25-a227af7fb924 tempest-SnapshotDependencyTests-1055191610 None] Create snapshot completed successfully Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (7f79a3ec-01c5-4f44-9f4a-250730f3c9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8159bd-ed98-48fe-9d86-490e2f7de693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8159bd-ed98-48fe-9d86-490e2f7de693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1336053555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdb9197-1f05-4610-89a2-318fc027c14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:58Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8dd8ec-4120-4f45-9ced-e779c2d5a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8dd8ec-4120-4f45-9ced-e779c2d5a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e18b672-8c6e-48f6-bc3b-d5a97ffd0afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e18b672-8c6e-48f6-bc3b-d5a97ffd0afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdb9197-1f05-4610-89a2-318fc027c14c', 'volume_name': 'volume-7cdb9197-1f05-4610-89a2-318fc027c14c', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e58ec7c-cd5d-496d-9b38-2efea949be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e58ec7c-cd5d-496d-9b38-2efea949be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227e1941-145b-4374-b16a-119ca8b23e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:57 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Volume 7cdb9197-1f05-4610-89a2-318fc027c14c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdb9197-1f05-4610-89a2-318fc027c14c', 'volume_size': 1} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1336053555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdb9197-1f05-4610-89a2-318fc027c14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:58Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Creating volume 7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:57 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:29:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:57 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c 1073741824 Apr 10 18:29:57 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:58 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c 1073741824" returned: 0 in 0.711s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:58 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c Apr 10 18:29:58 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Flow 'volume_create_manager' (50c4da32-f771-4227-abb9-41fb64fb2e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ec2ba0-5be2-4032-aefa-889c4909494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ec2ba0-5be2-4032-aefa-889c4909494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b2ff54-7959-4ef0-be5b-bb800253248c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd6e4948d34981b31e92ee79523709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0467282a-938f-41ea-9d5d-63d1de864901,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:29:59Z,use_quota=True,user_id='7c559faca7c043329b68564fda47ce53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cc68af-5a46-4072-ad19-6b427294ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cc68af-5a46-4072-ad19-6b427294ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55da1d33-6f57-4b6e-bcf0-a76e6ec71eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55da1d33-6f57-4b6e-bcf0-a76e6ec71eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '37b2ff54-7959-4ef0-be5b-bb800253248c', 'volume_name': 'volume-37b2ff54-7959-4ef0-be5b-bb800253248c', 'volume_size': 1, 'snapshot_id': '0467282a-938f-41ea-9d5d-63d1de864901'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0dd53b-4e34-45c5-a4e7-28749a238db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0dd53b-4e34-45c5-a4e7-28749a238db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9217a31-2ebc-4300-9b48-2c4972730be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:58 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Volume 37b2ff54-7959-4ef0-be5b-bb800253248c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-37b2ff54-7959-4ef0-be5b-bb800253248c', 'volume_size': 1, 'snapshot_id': '0467282a-938f-41ea-9d5d-63d1de864901'} Apr 10 18:29:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:59 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c" returned: 0 in 0.548s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.311s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-quobyte-0467282a-938f-41ea-9d5d-63d1de864901-37b2ff54-7959-4ef0-be5b-bb800253248c" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227e1941-145b-4374-b16a-119ca8b23e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdb9197-1f05-4610-89a2-318fc027c14c', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d76e7af-7e2d-438a-a075-698d24d91daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:29:59 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Volume volume-7cdb9197-1f05-4610-89a2-318fc027c14c (7cdb9197-1f05-4610-89a2-318fc027c14c): created successfully Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d76e7af-7e2d-438a-a075-698d24d91daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (7f79a3ec-01c5-4f44-9f4a-250730f3c9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-0467282a-938f-41ea-9d5d-63d1de864901-37b2ff54-7959-4ef0-be5b-bb800253248c" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Creating volume 37b2ff54-7959-4ef0-be5b-bb800253248c from snapshot 0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-quobyte-37b2ff54-7959-4ef0-be5b-bb800253248c" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:29:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-586f17f6-724c-4047-b65f-d1b258d25c0f tempest-VolumesSnapshotTestJSON-1968261558 None] Created volume successfully. Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-37b2ff54-7959-4ef0-be5b-bb800253248c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] snapshot: 0467282a-938f-41ea-9d5d-63d1de864901, volume: 37b2ff54-7959-4ef0-be5b-bb800253248c, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2299a68b-9776-465c-916a-949b2af5aae8]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:29:59 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 Apr 10 18:29:59 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:29:59 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901" returned: 0 in 0.682s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[148e8e0d-4db7-4534-8ccc-d3a0a8a0ba49]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:29:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:00 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:30:00 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:00 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.594s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:00 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:30:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:00 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c Apr 10 18:30:00 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:03 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c" returned: 0 in 2.625s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:03 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425804f-c8f7-437d-9d02-6ca79c695936]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:03 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:30:03 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:04 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.858s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:30:04 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Converted 1024.00 MB image at 389.88 MB/s Apr 10 18:30:04 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c is being set with open permissions: ugo+rw Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:04 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c Apr 10 18:30:04 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:04 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c" returned: 0 in 0.559s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-37b2ff54-7959-4ef0-be5b-bb800253248c" released by "_copy_volume_from_snapshot" :: held 5.380s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-0467282a-938f-41ea-9d5d-63d1de864901-37b2ff54-7959-4ef0-be5b-bb800253248c" released by "_create_volume_from_snapshot" :: held 5.404s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.446s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.453s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Creating offline snapshot a33f48f7-7033-4490-9cbf-f93235357894 of volume 7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9349177-afde-4f05-ae60-5061ffef5c56]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9217a31-2ebc-4300-9b48-2c4972730be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b2ff54-7959-4ef0-be5b-bb800253248c', 'volume_size': 1, 'snapshot_id': '0467282a-938f-41ea-9d5d-63d1de864901'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c69edd0-44f3-4801-81c1-1d4e8c57a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Volume volume-37b2ff54-7959-4ef0-be5b-bb800253248c (37b2ff54-7959-4ef0-be5b-bb800253248c): created successfully Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c69edd0-44f3-4801-81c1-1d4e8c57a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Flow 'volume_create_manager' (50c4da32-f771-4227-abb9-41fb64fb2e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6b1d457e-e223-4515-93bf-13761a3652d3 tempest-SnapshotDependencyTests-1055191610 None] Created volume successfully. Apr 10 18:30:04 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c Apr 10 18:30:04 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-0467282a-938f-41ea-9d5d-63d1de864901-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-0467282a-938f-41ea-9d5d-63d1de864901-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-quobyte-af15b7c2-d743-435a-80d7-8b4576e2c6ec" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-af15b7c2-d743-435a-80d7-8b4576e2c6ec" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-quobyte-0467282a-938f-41ea-9d5d-63d1de864901" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-0467282a-938f-41ea-9d5d-63d1de864901" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Deleting offline snapshot 0467282a-938f-41ea-9d5d-63d1de864901 of volume af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] snapshot_file for this snap is: volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa20bd9e-5e89-48b0-bac5-57cd5eb62d8c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:05 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 Apr 10 18:30:05 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:05 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c" returned: 0 in 0.938s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:05 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 1G Apr 10 18:30:05 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:06 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901" returned: 0 in 0.710s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e7299e-3c50-4564-ba94-ada96967aed1]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:06 devstack sudo[87776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:30:06 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:06 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 1G" returned: 0 in 0.703s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb9197-1f05-4610-89a2-318fc027c14c -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:06 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb9197-1f05-4610-89a2-318fc027c14c -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 Apr 10 18:30:06 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:06 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.719s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:06 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 Apr 10 18:30:06 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:06 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdb9197-1f05-4610-89a2-318fc027c14c -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894" returned: 0 in 0.671s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:06 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 is being set with open permissions: ugo+rw Apr 10 18:30:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:06 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 Apr 10 18:30:06 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:07 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901" returned: 0 in 0.537s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:07 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901 Apr 10 18:30:07 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:07 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894" returned: 0 in 0.488s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:07 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info Apr 10 18:30:07 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:07 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec.0467282a-938f-41ea-9d5d-63d1de864901" returned: 0 in 0.529s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-0467282a-938f-41ea-9d5d-63d1de864901" released by "_delete_snapshot" :: held 2.567s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-af15b7c2-d743-435a-80d7-8b4576e2c6ec" released by "delete_snapshot" :: held 2.585s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Created reservations ['7df3ba93-7e98-42b9-93fc-7f9baacdb869', '8476d29a-9724-41dd-8b6b-e0cde858f9e1', 'a60f81c1-cfdb-4f03-8148-685863c7e016', '96bf4ce9-6a2b-4f4c-b26c-c26d26740db2'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Delete snapshot completed successfully. Apr 10 18:30:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-55842995-ab34-4fc0-a145-5c01111d9ede tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-0467282a-938f-41ea-9d5d-63d1de864901-delete_snapshot" released by "delete_snapshot" :: held 2.687s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:08 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info" returned: 0 in 0.552s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:08 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info is being set with open permissions: ugo+rw Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:08 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info Apr 10 18:30:08 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-af15b7c2-d743-435a-80d7-8b4576e2c6ec-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-af15b7c2-d743-435a-80d7-8b4576e2c6ec-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-quobyte-af15b7c2-d743-435a-80d7-8b4576e2c6ec" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-af15b7c2-d743-435a-80d7-8b4576e2c6ec" acquired by "delete_volume" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:08 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.info" returned: 0 in 0.512s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.963s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a921d-ac48-4049-b71f-7806d366a484]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c643fc8c-85e9-427b-84ff-6f8c926be4be tempest-VolumesSnapshotTestJSON-1968261558 None] Create snapshot completed successfully Apr 10 18:30:08 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:30:08 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:09 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.548s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:09 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec Apr 10 18:30:09 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:09 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-af15b7c2-d743-435a-80d7-8b4576e2c6ec" returned: 0 in 0.534s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-af15b7c2-d743-435a-80d7-8b4576e2c6ec" released by "delete_volume" :: held 1.124s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Created reservations ['afc296dd-62b0-45a9-a292-31131af27c9e', '9030f9fb-9882-4338-b4b6-364786eeaf64', 'bb76388d-6788-41a3-9bcb-4e61a0ade088', '527dc52b-8fbf-464d-98fd-eac8780a8b8f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-a33f48f7-7033-4490-9cbf-f93235357894-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-a33f48f7-7033-4490-9cbf-f93235357894-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:09 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:09 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-7cdb9197-1f05-4610-89a2-318fc027c14c" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7cdb9197-1f05-4610-89a2-318fc027c14c" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-a33f48f7-7033-4490-9cbf-f93235357894" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-a33f48f7-7033-4490-9cbf-f93235357894" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Deleting offline snapshot a33f48f7-7033-4490-9cbf-f93235357894 of volume 7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] snapshot_file for this snap is: volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c9998c-3dea-40ff-893d-288b14aba389]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:09 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 Apr 10 18:30:09 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:10 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Flow 'volume_create_manager' (79aa0ee1-e7e5-491a-be44-2300622e67ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ff7361-ad30-49ca-abe6-7d40f251aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.650s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ff7361-ad30-49ca-abe6-7d40f251aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1758388500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d5e670b5b844c7a08924c6eefebbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:10Z,use_quota=True,user_id='369618ada67647d09c89689700e8aa4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3619fd81-16a0-486d-8ff0-86b4a2e3828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3619fd81-16a0-486d-8ff0-86b4a2e3828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fbc4a1-b16c-42a0-801e-6ee92628512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fbc4a1-b16c-42a0-801e-6ee92628512d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4', 'volume_name': 'volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8463c105-da04-4410-ba4a-e750d7fe7e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8463c105-da04-4410-ba4a-e750d7fe7e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8563afce-51f6-4c7b-bb96-3c57f5155edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:10 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Volume 5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4', 'volume_size': 1} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1758388500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d5e670b5b844c7a08924c6eefebbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:10Z,use_quota=True,user_id='369618ada67647d09c89689700e8aa4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Creating volume 5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:10 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Deleted volume successfully. Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b55fbce2-0c82-4c93-96fa-f4054ed48e64 tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-af15b7c2-d743-435a-80d7-8b4576e2c6ec-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:10 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894" returned: 0 in 0.673s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdb9197-1f05-4610-89a2-318fc027c14c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:10 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 1073741824 Apr 10 18:30:10 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3817b09e-0732-43e2-af16-21c209eb0739]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:10 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c Apr 10 18:30:10 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-37b2ff54-7959-4ef0-be5b-bb800253248c-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-37b2ff54-7959-4ef0-be5b-bb800253248c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "cinder-quobyte-37b2ff54-7959-4ef0-be5b-bb800253248c" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-37b2ff54-7959-4ef0-be5b-bb800253248c" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa249066-85c3-4a0c-ad61-d6878681cc08]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:10 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c Apr 10 18:30:10 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:11 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 1073741824" returned: 0 in 0.875s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:11 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c" returned: 0 in 0.832s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:11 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 Apr 10 18:30:11 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:11 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 Apr 10 18:30:11 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:11 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c" returned: 0 in 1.037s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:11 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c Apr 10 18:30:11 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:12 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894" returned: 0 in 0.649s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:12 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4" returned: 0 in 0.657s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:12 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894 Apr 10 18:30:12 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8563afce-51f6-4c7b-bb96-3c57f5155edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e3d478-5cbe-4a9b-858d-f425c5c5673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:12 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Volume volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 (5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4): created successfully Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e3d478-5cbe-4a9b-858d-f425c5c5673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Flow 'volume_create_manager' (79aa0ee1-e7e5-491a-be44-2300622e67ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a0c2e20c-b5dd-46ef-80be-1b8226fa2d2a tempest-VolumesTransfersTest-1534854728 None] Created volume successfully. Apr 10 18:30:12 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-37b2ff54-7959-4ef0-be5b-bb800253248c" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-quobyte-37b2ff54-7959-4ef0-be5b-bb800253248c" released by "delete_volume" :: held 1.564s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Created reservations ['fe4e0da1-2a04-4214-af99-6caf90b53098', 'b2d2792c-3094-49e5-a4a0-b7da8a9869d9', 'c8afae3b-b590-45f2-8def-c75376b6e15e', 'a5f26c68-d45a-4e8f-b4f5-9ddf08072ab4'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:12 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:12 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:12 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c.a33f48f7-7033-4490-9cbf-f93235357894" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-a33f48f7-7033-4490-9cbf-f93235357894" released by "_delete_snapshot" :: held 2.690s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7cdb9197-1f05-4610-89a2-318fc027c14c" released by "delete_snapshot" :: held 2.706s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['526dd29e-f0b5-4a6c-b9eb-2a49f499e6e7', '39571758-a33a-47db-9b3b-9a446d474652', '4b09adec-aab5-460c-b0ec-0a6922a304ad', '3308dd77-427f-4f9b-8059-8136109bd7d6'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Delete snapshot completed successfully. Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-ff77b313-4a88-4851-a7a7-aafcd4f9095e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-a33f48f7-7033-4490-9cbf-f93235357894-delete_snapshot" released by "delete_snapshot" :: held 2.857s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:12 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.513s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Deleted volume successfully. Apr 10 18:30:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-26b587d3-8718-4a44-93ac-ec26ef0e599d tempest-SnapshotDependencyTests-1055191610 None] Lock "cinder-37b2ff54-7959-4ef0-be5b-bb800253248c-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9290d0d3-8a02-44ba-9fa0-1b865d8c5b8d tempest-VolumesTransfersTest-1628608641 None] Transfer volume completed successfully. Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (9014311c-2332-4c3d-b2a6-072cdcd7100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993823af-a008-4706-b6ae-02001144b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993823af-a008-4706-b6ae-02001144b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1178014276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178cbd26-bc89-4780-a774-7dafe94cca0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:13Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0db61f2-0f0c-4961-9114-634ae3216846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0db61f2-0f0c-4961-9114-634ae3216846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e192dbb-c806-4f74-8f10-c54189a579da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e192dbb-c806-4f74-8f10-c54189a579da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178cbd26-bc89-4780-a774-7dafe94cca0d', 'volume_name': 'volume-178cbd26-bc89-4780-a774-7dafe94cca0d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae68ed7-b3e6-43f9-8c1e-b18e50c70d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae68ed7-b3e6-43f9-8c1e-b18e50c70d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3c23c1-5aff-4420-99b5-132d32268931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:13 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume 178cbd26-bc89-4780-a774-7dafe94cca0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178cbd26-bc89-4780-a774-7dafe94cca0d', 'volume_size': 1} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1178014276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178cbd26-bc89-4780-a774-7dafe94cca0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:13Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Creating volume 178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:13 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:13 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d 1073741824 Apr 10 18:30:13 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Acquiring lock "cinder-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Acquiring lock "cinder-quobyte-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:13 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d 1073741824" returned: 0 in 0.685s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-quobyte-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92224b1-250d-461b-be33-74048c665ea2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:14 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:14 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:14 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 Apr 10 18:30:14 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:14 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4" returned: 0 in 0.565s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:14 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4 Apr 10 18:30:14 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:14 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.607s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3c23c1-5aff-4420-99b5-132d32268931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178cbd26-bc89-4780-a774-7dafe94cca0d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51188993-891d-46e2-ace2-082ea119a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume volume-178cbd26-bc89-4780-a774-7dafe94cca0d (178cbd26-bc89-4780-a774-7dafe94cca0d): created successfully Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51188993-891d-46e2-ace2-082ea119a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (9014311c-2332-4c3d-b2a6-072cdcd7100f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:14 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-839ff03a-e4f2-4c8c-9f0f-21a2eac563b9 tempest-VolumesSnapshotTestJSON-1968261558 None] Created volume successfully. Apr 10 18:30:15 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4" returned: 0 in 0.531s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-quobyte-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4" released by "delete_volume" :: held 1.123s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Created reservations ['31cf7d73-d3ee-482a-8797-e3a8b0228f20', 'a28c531d-52cd-406c-8a7a-8cd0438855a3', '5d4a99f7-49ea-41fa-8a89-f47ac2678a42', '68201865-ff51-4704-b4df-46b3192faacb'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:15 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:15 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Creating offline snapshot 7f81ea0b-7035-474f-80ec-fb0d46d40251 of volume 178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[972896e2-6df6-45ca-a400-4de84b846463]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:15 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:15 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:15 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.583s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:15 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Deleted volume successfully. Apr 10 18:30:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-681b79c3-28b9-41ae-b3f3-3130b90d7569 tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-5d295b0d-d1ac-4aa4-80e1-dc480f70d3d4-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:16 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.631s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:16 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 1G Apr 10 18:30:16 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Flow 'volume_create_manager' (02865e9e-e22a-42b0-8761-3e92955fbf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcd5ed7-7d9a-49b6-a027-fa90d6b8d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcd5ed7-7d9a-49b6-a027-fa90d6b8d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-23944821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89523abc-09e3-43d1-b057-5c5d80c3b4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d5e670b5b844c7a08924c6eefebbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:16Z,use_quota=True,user_id='369618ada67647d09c89689700e8aa4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fd8f32-4859-4ff3-9428-fdf9beb4e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fd8f32-4859-4ff3-9428-fdf9beb4e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7d6685-7c2a-4d37-b80d-4826145caed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7d6685-7c2a-4d37-b80d-4826145caed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89523abc-09e3-43d1-b057-5c5d80c3b4e5', 'volume_name': 'volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29253c77-7493-4eca-ad70-435d13c40597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29253c77-7493-4eca-ad70-435d13c40597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b588aa03-1e82-4605-b0e2-e3d8f56f1dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:16 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Volume 89523abc-09e3-43d1-b057-5c5d80c3b4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5', 'volume_size': 1} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:16 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 1G" returned: 0 in 0.599s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178cbd26-bc89-4780-a774-7dafe94cca0d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:16 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178cbd26-bc89-4780-a774-7dafe94cca0d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 Apr 10 18:30:16 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:16 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:16 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:17 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178cbd26-bc89-4780-a774-7dafe94cca0d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:17 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 is being set with open permissions: ugo+rw Apr 10 18:30:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:17 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 Apr 10 18:30:17 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:17 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.607s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:17 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:17 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info Apr 10 18:30:17 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:18 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:18 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info is being set with open permissions: ugo+rw Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:18 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info Apr 10 18:30:18 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:18 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.info" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.230s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-23944821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89523abc-09e3-43d1-b057-5c5d80c3b4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d5e670b5b844c7a08924c6eefebbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:16Z,use_quota=True,user_id='369618ada67647d09c89689700e8aa4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Creating volume 89523abc-09e3-43d1-b057-5c5d80c3b4e5 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:18 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:18 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 1073741824 Apr 10 18:30:18 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ae6dd45c-4bbc-4736-92de-419f627d0262 tempest-VolumesSnapshotTestJSON-1968261558 None] Create snapshot completed successfully Apr 10 18:30:19 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 1073741824" returned: 0 in 0.572s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:19 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 Apr 10 18:30:19 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:19 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b588aa03-1e82-4605-b0e2-e3d8f56f1dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaec3cf-66de-43e7-af77-9e1e9a29013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:19 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Volume volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 (89523abc-09e3-43d1-b057-5c5d80c3b4e5): created successfully Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eaec3cf-66de-43e7-af77-9e1e9a29013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Flow 'volume_create_manager' (02865e9e-e22a-42b0-8761-3e92955fbf2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bb435038-f5e9-4866-903b-9e8f5684ddfe tempest-VolumesTransfersTest-1534854728 None] Created volume successfully. Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (b9a63f94-5693-4c61-b731-3c3f944c145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d1ab81-503f-4e65-a515-ffa0825ece18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d1ab81-503f-4e65-a515-ffa0825ece18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1791538202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a847d5-5330-4d08-a03c-92ab495d44c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7f81ea0b-7035-474f-80ec-fb0d46d40251,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:20Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46555f25-b44b-42a4-b122-870df3a25190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46555f25-b44b-42a4-b122-870df3a25190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07083c29-af06-4e0e-b433-53286c8a4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07083c29-af06-4e0e-b433-53286c8a4c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41a847d5-5330-4d08-a03c-92ab495d44c7', 'volume_name': 'volume-41a847d5-5330-4d08-a03c-92ab495d44c7', 'volume_size': 2, 'snapshot_id': '7f81ea0b-7035-474f-80ec-fb0d46d40251'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3af8a0-3eeb-4ce0-9864-30b1810ede46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3af8a0-3eeb-4ce0-9864-30b1810ede46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d8cd57-3621-446a-8bb0-6b65c40ab396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:20 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume 41a847d5-5330-4d08-a03c-92ab495d44c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41a847d5-5330-4d08-a03c-92ab495d44c7', 'volume_size': 2, 'snapshot_id': '7f81ea0b-7035-474f-80ec-fb0d46d40251'} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-7f81ea0b-7035-474f-80ec-fb0d46d40251-41a847d5-5330-4d08-a03c-92ab495d44c7" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7f81ea0b-7035-474f-80ec-fb0d46d40251-41a847d5-5330-4d08-a03c-92ab495d44c7" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Creating volume 41a847d5-5330-4d08-a03c-92ab495d44c7 from snapshot 7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-41a847d5-5330-4d08-a03c-92ab495d44c7" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-41a847d5-5330-4d08-a03c-92ab495d44c7" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] snapshot: 7f81ea0b-7035-474f-80ec-fb0d46d40251, volume: 41a847d5-5330-4d08-a03c-92ab495d44c7, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fd6b02-6329-4733-a98d-fe9f8738abd4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:20 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 Apr 10 18:30:20 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:20 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251" returned: 0 in 0.536s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-178cbd26-bc89-4780-a774-7dafe94cca0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[349eccc5-9cd7-4264-a026-5605bbe92553]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:20 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:20 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Acquiring lock "cinder-89523abc-09e3-43d1-b057-5c5d80c3b4e5-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-89523abc-09e3-43d1-b057-5c5d80c3b4e5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Acquiring lock "cinder-quobyte-89523abc-09e3-43d1-b057-5c5d80c3b4e5" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-quobyte-89523abc-09e3-43d1-b057-5c5d80c3b4e5" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0841ef9d-ef20-418f-ae64-cb90e9248c8b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:21 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 Apr 10 18:30:21 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:21 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.555s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:21 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:30:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:21 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 Apr 10 18:30:21 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:21 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5" returned: 0 in 0.558s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:21 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5 Apr 10 18:30:21 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:22 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-89523abc-09e3-43d1-b057-5c5d80c3b4e5" returned: 0 in 1.017s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-quobyte-89523abc-09e3-43d1-b057-5c5d80c3b4e5" released by "delete_volume" :: held 1.613s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Created reservations ['bdda02cf-a34a-4c66-b030-3ad82f275f94', '474f7cd8-5c19-499c-aef1-fea45f42da52', '4d3bace3-daf6-4b4e-b528-e1c37cb942d3', 'ab8a8e67-49c7-48d4-b843-eaf3573ad2e6'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:22 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:22 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:23 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7" returned: 0 in 2.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:23 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f95971-8f57-46b4-883d-8ea581a4cf7c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:23 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.206s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:23 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Deleted volume successfully. Apr 10 18:30:23 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-90861fb1-a731-449f-bb8e-e2d80178c96a tempest-VolumesTransfersTest-1018400112 None] Lock "cinder-89523abc-09e3-43d1-b057-5c5d80c3b4e5-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:23 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:24 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.727s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:24 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:30:24 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Converted 1024.00 MB image at 407.94 MB/s Apr 10 18:30:24 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 is being set with open permissions: ugo+rw Apr 10 18:30:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:24 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 Apr 10 18:30:24 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:25 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-41a847d5-5330-4d08-a03c-92ab495d44c7" released by "_copy_volume_from_snapshot" :: held 4.911s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7f81ea0b-7035-474f-80ec-fb0d46d40251-41a847d5-5330-4d08-a03c-92ab495d44c7" released by "_create_volume_from_snapshot" :: held 4.933s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.943s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d8cd57-3621-446a-8bb0-6b65c40ab396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a847d5-5330-4d08-a03c-92ab495d44c7', 'volume_size': 2, 'snapshot_id': '7f81ea0b-7035-474f-80ec-fb0d46d40251'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430c666d-c376-41fd-bcc6-2b00d0f28182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:25 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume volume-41a847d5-5330-4d08-a03c-92ab495d44c7 (41a847d5-5330-4d08-a03c-92ab495d44c7): created successfully Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430c666d-c376-41fd-bcc6-2b00d0f28182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (b9a63f94-5693-4c61-b731-3c3f944c145a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-82c73f89-3752-4b1b-a5b0-90d72c8a8508 tempest-VolumesSnapshotTestJSON-1968261558 None] Created volume successfully. Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-41a847d5-5330-4d08-a03c-92ab495d44c7-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-41a847d5-5330-4d08-a03c-92ab495d44c7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-41a847d5-5330-4d08-a03c-92ab495d44c7" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-41a847d5-5330-4d08-a03c-92ab495d44c7" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad3986-44e8-452c-9c9e-09b84e65396b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:25 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 Apr 10 18:30:25 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:26 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7" returned: 0 in 0.637s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:26 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7 Apr 10 18:30:26 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:26 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-41a847d5-5330-4d08-a03c-92ab495d44c7" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-41a847d5-5330-4d08-a03c-92ab495d44c7" released by "delete_volume" :: held 1.132s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['d15ee18d-9027-46ef-92d5-ee8629e62ce4', 'afa14586-7582-4988-b550-0eb9a4fa1863', '8690d620-1081-4906-b89f-758e8c12cb3f', '05673422-fcd1-478b-abfe-32fa3515bbd9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:26 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:26 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Flow 'volume_create_manager' (d43f4bef-ff5f-4f16-b465-54286977bf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484da029-e731-46b4-9848-12f775cd5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (484da029-e731-46b4-9848-12f775cd5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-729510522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e13d6dd-d8d1-468a-98ef-19b38d83f9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2828cbbb7e5e4d23846167baf1e83efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:27Z,use_quota=True,user_id='eddc94b920f045b48fd6653a42d62ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ab5b6f-6e29-4334-bb13-2902e697cb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ab5b6f-6e29-4334-bb13-2902e697cb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0b987d-1c32-4123-a52f-718c990c8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0b987d-1c32-4123-a52f-718c990c8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e13d6dd-d8d1-468a-98ef-19b38d83f9d6', 'volume_name': 'volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6', 'volume_size': 2}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2893d78-d841-4fbb-b3b2-acaf2bda35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2893d78-d841-4fbb-b3b2-acaf2bda35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae88d742-9d25-4e16-9583-ac896bb9ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:27 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Volume 5e13d6dd-d8d1-468a-98ef-19b38d83f9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6', 'volume_size': 2} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-729510522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e13d6dd-d8d1-468a-98ef-19b38d83f9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2828cbbb7e5e4d23846167baf1e83efe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:27Z,use_quota=True,user_id='eddc94b920f045b48fd6653a42d62ba6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Creating volume 5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:27 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 2147483648 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:27 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 2147483648 Apr 10 18:30:27 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:27 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:27 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Deleted volume successfully. Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-320ed231-6456-494e-9493-36cdd22e02f7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-41a847d5-5330-4d08-a03c-92ab495d44c7-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:27 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 2147483648" returned: 0 in 0.530s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:27 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 Apr 10 18:30:27 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-7f81ea0b-7035-474f-80ec-fb0d46d40251-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-7f81ea0b-7035-474f-80ec-fb0d46d40251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-178cbd26-bc89-4780-a774-7dafe94cca0d" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-178cbd26-bc89-4780-a774-7dafe94cca0d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-7f81ea0b-7035-474f-80ec-fb0d46d40251" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7f81ea0b-7035-474f-80ec-fb0d46d40251" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Deleting offline snapshot 7f81ea0b-7035-474f-80ec-fb0d46d40251 of volume 178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] snapshot_file for this snap is: volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f91ef62-3632-4d46-8e47-0a49ff317d91]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:27 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 Apr 10 18:30:27 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:28 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae88d742-9d25-4e16-9583-ac896bb9ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6', 'volume_size': 2}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a822060a-c9c5-4a00-a7aa-d2760d2bb19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:28 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Volume volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 (5e13d6dd-d8d1-468a-98ef-19b38d83f9d6): created successfully Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a822060a-c9c5-4a00-a7aa-d2760d2bb19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Flow 'volume_create_manager' (d43f4bef-ff5f-4f16-b465-54286977bf94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-24d074a1-6f8d-4652-a6d5-92a048ad7706 tempest-VolumesCloneNegativeTest-1559730016 None] Created volume successfully. Apr 10 18:30:28 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251" returned: 0 in 0.490s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-178cbd26-bc89-4780-a774-7dafe94cca0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba969dc-4bb7-416f-8113-a5bcfbe7c8aa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:28 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:28 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:28 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.525s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:28 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 Apr 10 18:30:28 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Acquiring lock "cinder-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "cinder-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Acquiring lock "cinder-quobyte-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "cinder-quobyte-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e4673-ca94-4695-860d-0c91c689c764]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:29 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251" returned: 0 in 0.699s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:29 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 Apr 10 18:30:29 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:29 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251 Apr 10 18:30:29 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:30 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d.7f81ea0b-7035-474f-80ec-fb0d46d40251" returned: 0 in 0.500s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:30 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7f81ea0b-7035-474f-80ec-fb0d46d40251" released by "_delete_snapshot" :: held 2.277s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6" returned: 0 in 0.604s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-178cbd26-bc89-4780-a774-7dafe94cca0d" released by "delete_snapshot" :: held 2.296s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:30 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6 Apr 10 18:30:30 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['1770dbb6-9639-4a51-a166-72da183cf857', '84e320e7-a652-495e-9446-29f62f694809', '30dc47fb-261c-4404-b754-d121e9f51666', 'c07a900a-765d-4a41-b3a1-cd4a672ea645'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Delete snapshot completed successfully. Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3045b4a0-6aa5-4297-a324-0b92382898d4 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-7f81ea0b-7035-474f-80ec-fb0d46d40251-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:30 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "cinder-quobyte-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6" released by "delete_volume" :: held 1.127s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Created reservations ['0c27dade-d418-4a16-bfae-b6984cb7ac4f', '851a3a02-a2e3-40b1-9fcf-350b4fb93df4', 'a83cd002-e95b-42bc-9249-0140e9a2ee6f', '5d94df0d-ba34-40bd-9b09-34a62917cd6a'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:30 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:30 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-178cbd26-bc89-4780-a774-7dafe94cca0d-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-178cbd26-bc89-4780-a774-7dafe94cca0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-178cbd26-bc89-4780-a774-7dafe94cca0d" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-178cbd26-bc89-4780-a774-7dafe94cca0d" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:31 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Deleted volume successfully. Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7d2fd-c707-4f6f-9c44-c6d5f615c752]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a17029a8-2470-4f08-b4f9-fbb74c575977 tempest-VolumesCloneNegativeTest-1559730016 None] Lock "cinder-5e13d6dd-d8d1-468a-98ef-19b38d83f9d6-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:31 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:31 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (a787bb0e-07e5-4db9-b838-9f87a217d0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b37d8-0451-4a9d-941b-e9d79e742851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9b37d8-0451-4a9d-941b-e9d79e742851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1009054421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bc8b3b-798c-418f-a869-22d58e6c38c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:31Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd46d96-f19c-49f0-8ca2-9f1acf5617d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd46d96-f19c-49f0-8ca2-9f1acf5617d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe64dd05-c8d5-461c-b97d-2c2681f899ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe64dd05-c8d5-461c-b97d-2c2681f899ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57bc8b3b-798c-418f-a869-22d58e6c38c4', 'volume_name': 'volume-57bc8b3b-798c-418f-a869-22d58e6c38c4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9acb590-80c7-4162-bf1b-4ea8d70c9564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9acb590-80c7-4162-bf1b-4ea8d70c9564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc675173-25ea-43db-a364-df6e0747ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:31 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Volume 57bc8b3b-798c-418f-a869-22d58e6c38c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57bc8b3b-798c-418f-a869-22d58e6c38c4', 'volume_size': 1} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1009054421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bc8b3b-798c-418f-a869-22d58e6c38c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:31Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Creating volume 57bc8b3b-798c-418f-a869-22d58e6c38c4 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:31 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:31 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 1073741824 Apr 10 18:30:31 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:31 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.573s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:31 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d Apr 10 18:30:31 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:32 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 1073741824" returned: 0 in 0.569s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:32 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 Apr 10 18:30:32 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:32 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-178cbd26-bc89-4780-a774-7dafe94cca0d" returned: 0 in 0.614s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-178cbd26-bc89-4780-a774-7dafe94cca0d" released by "delete_volume" :: held 1.242s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['1264d991-5876-4a83-8e33-a9c67bc76e3e', '0038cd4b-2951-4d45-b260-c1cc0296f469', '3b09b6d5-6167-469e-abdb-4361d3b8b9f3', '20079aa0-0da9-4a43-9acc-293e8230dfe8'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:32 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:32 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:32 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc675173-25ea-43db-a364-df6e0747ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bc8b3b-798c-418f-a869-22d58e6c38c4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcde882-65d9-4bf4-ad77-66d39510a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:32 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Volume volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 (57bc8b3b-798c-418f-a869-22d58e6c38c4): created successfully Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcde882-65d9-4bf4-ad77-66d39510a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (a787bb0e-07e5-4db9-b838-9f87a217d0e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:32 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f5ccaade-ffb5-48df-ae47-8e8e1ad7036e tempest-VolumesActionsTest-1060394911 None] Created volume successfully. Apr 10 18:30:32 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:32 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Deleted volume successfully. Apr 10 18:30:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-24ed7e99-a863-440c-a459-d0b8c5b6bffc tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-178cbd26-bc89-4780-a774-7dafe94cca0d-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Flow 'volume_create_manager' (ab9bc24a-7df2-4c67-864f-ed9567e39ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81ff991-302b-4a2a-afcd-11ccff450370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81ff991-302b-4a2a-afcd-11ccff450370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1232714080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698986a9-ce48-41e0-8375-56cb793b2db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe14bd35c514cbea336d4ed63c1b550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:33Z,use_quota=True,user_id='cde3b3f53e654bffb9ba5f9b570514f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f9ec53-8c86-460e-aea3-84f49b902704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f9ec53-8c86-460e-aea3-84f49b902704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2c1804-a5bb-4440-80a5-22363f12ec9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2c1804-a5bb-4440-80a5-22363f12ec9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698986a9-ce48-41e0-8375-56cb793b2db3', 'volume_name': 'volume-698986a9-ce48-41e0-8375-56cb793b2db3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56481b0-1b2a-4abd-b22d-a8ff59c838d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e56481b0-1b2a-4abd-b22d-a8ff59c838d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26000ea1-5511-4e2e-8fcc-de1a82d90b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Volume 698986a9-ce48-41e0-8375-56cb793b2db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698986a9-ce48-41e0-8375-56cb793b2db3', 'volume_size': 1} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1232714080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698986a9-ce48-41e0-8375-56cb793b2db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe14bd35c514cbea336d4ed63c1b550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:33Z,use_quota=True,user_id='cde3b3f53e654bffb9ba5f9b570514f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Creating volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:33 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:33 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 1073741824 Apr 10 18:30:33 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (2e58058b-bf85-4ba6-9ddb-61781f9b0cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090413db-d988-4e5a-8763-9a2bcde2bc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090413db-d988-4e5a-8763-9a2bcde2bc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-277246290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155ee3fb-58ca-410a-b5fb-cc8e755031fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:33Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476339d2-f209-4bc2-84c6-4895c62b9cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476339d2-f209-4bc2-84c6-4895c62b9cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9257d9-7e6c-4e6e-af51-e36c4ea93d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9257d9-7e6c-4e6e-af51-e36c4ea93d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155ee3fb-58ca-410a-b5fb-cc8e755031fb', 'volume_name': 'volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25ded65-cf17-461d-b012-62e7d821ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25ded65-cf17-461d-b012-62e7d821ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeff5c4-266b-4428-90d3-187d7eb10ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:33 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume 155ee3fb-58ca-410a-b5fb-cc8e755031fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb', 'volume_size': 1} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f3443f0b-5520-4843-976f-77e876bc4d5a tempest-VolumesActionsTest-1060394911 None] Acquiring lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4" by "attach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f3443f0b-5520-4843-976f-77e876bc4d5a tempest-VolumesActionsTest-1060394911 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4" acquired by "attach_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f3443f0b-5520-4843-976f-77e876bc4d5a tempest-VolumesActionsTest-1060394911 None] Attaching volume 57bc8b3b-798c-418f-a869-22d58e6c38c4 to instance dfe81f5e-9bfa-46ab-9baf-4b1aa8961f48 at mountpoint /dev/vdb on host None. Apr 10 18:30:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f3443f0b-5520-4843-976f-77e876bc4d5a tempest-VolumesActionsTest-1060394911 None] Attach volume completed successfully. Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f3443f0b-5520-4843-976f-77e876bc4d5a tempest-VolumesActionsTest-1060394911 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4" released by "attach_volume" :: held 0.046s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:33 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 1073741824" returned: 0 in 0.525s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:33 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 Apr 10 18:30:33 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:34 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3" returned: 0 in 0.437s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-277246290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155ee3fb-58ca-410a-b5fb-cc8e755031fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:33Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Creating volume 155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:34 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26000ea1-5511-4e2e-8fcc-de1a82d90b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698986a9-ce48-41e0-8375-56cb793b2db3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:34 devstack sudo[88092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb 1073741824 Apr 10 18:30:34 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67902f0f-c171-45fe-b579-fda2e59f9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:34 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Volume volume-698986a9-ce48-41e0-8375-56cb793b2db3 (698986a9-ce48-41e0-8375-56cb793b2db3): created successfully Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67902f0f-c171-45fe-b579-fda2e59f9778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Flow 'volume_create_manager' (ab9bc24a-7df2-4c67-864f-ed9567e39ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:34 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e4afce0e-4234-4f31-b7f3-680e51d29cd7 tempest-VolumesSnapshotListTestJSON-1053123739 None] Created volume successfully. Apr 10 18:30:34 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bdb38884-db22-4337-af73-50e76b5ed097 tempest-VolumesActionsTest-401695264 None] Terminate volume connection completed successfully. Apr 10 18:30:34 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb 1073741824" returned: 0 in 0.489s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:34 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:34 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bdb38884-db22-4337-af73-50e76b5ed097 tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-detach_volume" by "detach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bdb38884-db22-4337-af73-50e76b5ed097 tempest-VolumesActionsTest-401695264 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bdb38884-db22-4337-af73-50e76b5ed097 tempest-VolumesActionsTest-401695264 None] Detaching volume 57bc8b3b-798c-418f-a869-22d58e6c38c4 from instance dfe81f5e-9bfa-46ab-9baf-4b1aa8961f48. Apr 10 18:30:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bdb38884-db22-4337-af73-50e76b5ed097 tempest-VolumesActionsTest-401695264 None] Detach volume completed successfully. Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bdb38884-db22-4337-af73-50e76b5ed097 tempest-VolumesActionsTest-401695264 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:35 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aeff5c4-266b-4428-90d3-187d7eb10ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c93204-4b9f-468d-8f44-ec68f30f1657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:35 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Volume volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb (155ee3fb-58ca-410a-b5fb-cc8e755031fb): created successfully Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c93204-4b9f-468d-8f44-ec68f30f1657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (2e58058b-bf85-4ba6-9ddb-61781f9b0cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5201268a-621e-42de-87c9-f80ca782e516 tempest-VolumesSnapshotTestJSON-1968261558 None] Created volume successfully. Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Creating offline snapshot 8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a of volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6132705e-b70d-4143-886e-3f054113df35]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e950fd47-fc93-4ffd-992a-dfc5974bf7ae tempest-VolumesActionsTest-1060394911 None] Acquiring lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-detach_volume" by "detach_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e950fd47-fc93-4ffd-992a-dfc5974bf7ae tempest-VolumesActionsTest-1060394911 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e950fd47-fc93-4ffd-992a-dfc5974bf7ae tempest-VolumesActionsTest-1060394911 None] Volume detach called, but volume not attached. Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e950fd47-fc93-4ffd-992a-dfc5974bf7ae tempest-VolumesActionsTest-1060394911 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:35 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 Apr 10 18:30:35 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:36 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3" returned: 0 in 0.533s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:36 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a 1G Apr 10 18:30:36 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "cinder-quobyte-57bc8b3b-798c-418f-a869-22d58e6c38c4" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-quobyte-57bc8b3b-798c-418f-a869-22d58e6c38c4" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f5b3d-4ace-4bdb-8482-82be76ba60d9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:36 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 Apr 10 18:30:36 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:36 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a 1G" returned: 0 in 0.513s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:36 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:36 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:36 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4" returned: 0 in 0.546s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:36 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4 Apr 10 18:30:36 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:37 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:37 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a is being set with open permissions: ugo+rw Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:37 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:37 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:37 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-57bc8b3b-798c-418f-a869-22d58e6c38c4" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-quobyte-57bc8b3b-798c-418f-a869-22d58e6c38c4" released by "delete_volume" :: held 1.047s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Created reservations ['feb5d40c-062a-4cab-b827-918b25182f0a', 'ec02108e-33c9-4b87-a52a-5344a91e7dd8', '79ee95c6-a034-4199-9528-f0e9178cf3da', 'c9feab7a-f53d-4bfb-85e2-ac35a004c9c1'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:37 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.438s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:37 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:37 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:37 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info Apr 10 18:30:37 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:37 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:37 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Deleted volume successfully. Apr 10 18:30:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9197991c-1bb7-4786-a3e9-ad5a1ce8faf0 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-57bc8b3b-798c-418f-a869-22d58e6c38c4-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:38 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:38 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info is being set with open permissions: ugo+rw Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:38 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info Apr 10 18:30:38 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:38 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.info" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.875s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.680s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Creating offline snapshot 2dc296e2-e589-4968-92fe-4ca35e7cb558 of volume 155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:30:38 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e9f28e65-5ff2-400f-bd89-36a35328f360 tempest-VolumesSnapshotListTestJSON-1053123739 None] Create snapshot completed successfully Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[849427f3-9627-4e56-95c9-626f4f34312b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:38 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:38 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:39 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.515s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:39 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 1G Apr 10 18:30:39 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:39 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 1G" returned: 0 in 0.471s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:39 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 Apr 10 18:30:39 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:40 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558" returned: 0 in 0.527s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:40 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 is being set with open permissions: ugo+rw Apr 10 18:30:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:40 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 Apr 10 18:30:40 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:40 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558" returned: 0 in 0.440s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:40 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info Apr 10 18:30:40 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:40 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info" returned: 0 in 0.421s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:40 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info is being set with open permissions: ugo+rw Apr 10 18:30:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:40 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info Apr 10 18:30:40 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:41 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.info" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.924s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.551s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Creating offline snapshot 0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 of volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:30:41 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-eeaa958f-eadc-4c68-9809-f481c07f9e16 tempest-VolumesSnapshotTestJSON-1968261558 None] Create snapshot completed successfully Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[072116b1-d08b-4835-9be6-dff15026e399]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:41 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:41 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:41 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.484s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:41 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 1G Apr 10 18:30:41 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (f87e2289-4819-4845-b31b-3e5cde69d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d070089-690d-4786-98cd-c97e48b28327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d070089-690d-4786-98cd-c97e48b28327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-517121681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d2717a-d053-4156-91fd-0bcfa57e6c28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a6f77b3a1b54503972b5fa4b51f87df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2dc296e2-e589-4968-92fe-4ca35e7cb558,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:42Z,use_quota=True,user_id='5208fa450249471d832af3b98871eb67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ad6a71-aeff-4230-a309-8f6a254ae077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ad6a71-aeff-4230-a309-8f6a254ae077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3770f5-100b-4d01-bf2e-8d290fcd4871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe3770f5-100b-4d01-bf2e-8d290fcd4871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1d2717a-d053-4156-91fd-0bcfa57e6c28', 'volume_name': 'volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28', 'volume_size': 1, 'snapshot_id': '2dc296e2-e589-4968-92fe-4ca35e7cb558'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0022683-19c1-431c-aff6-929ae9151807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0022683-19c1-431c-aff6-929ae9151807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee3ad22-e598-40c2-9c59-0d9862943736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:42 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Volume e1d2717a-d053-4156-91fd-0bcfa57e6c28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28', 'volume_size': 1, 'snapshot_id': '2dc296e2-e589-4968-92fe-4ca35e7cb558'} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:42 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 1G" returned: 0 in 0.541s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:42 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:42 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:42 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.469s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:42 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 is being set with open permissions: ugo+rw Apr 10 18:30:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:42 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:42 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:43 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.418s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.028s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-2dc296e2-e589-4968-92fe-4ca35e7cb558-e1d2717a-d053-4156-91fd-0bcfa57e6c28" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:43 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-52fac7d6-6f44-4ec2-bcf1-ef733026476d tempest-VolumesSnapshotListTestJSON-1053123739 None] Create snapshot completed successfully Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-2dc296e2-e589-4968-92fe-4ca35e7cb558-e1d2717a-d053-4156-91fd-0bcfa57e6c28" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Creating volume e1d2717a-d053-4156-91fd-0bcfa57e6c28 from snapshot 2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-e1d2717a-d053-4156-91fd-0bcfa57e6c28" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-e1d2717a-d053-4156-91fd-0bcfa57e6c28" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] snapshot: 2dc296e2-e589-4968-92fe-4ca35e7cb558, volume: e1d2717a-d053-4156-91fd-0bcfa57e6c28, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0af8c8-ba3d-42f9-a3e7-210a2b6d4c63]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:43 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 Apr 10 18:30:43 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:43 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558" returned: 0 in 0.501s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[88827164-a015-4f80-8051-219f92f25dc8]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:44 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:44 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:44 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:44 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 Apr 10 18:30:44 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (05dd8dbf-d9f7-425d-9ee9-329eea788856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf4734-0958-4d3c-b54f-e1ce8d8fb451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fcf4734-0958-4d3c-b54f-e1ce8d8fb451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874714974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:45Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c699ed1-2006-4c5b-a037-d35524b07d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c699ed1-2006-4c5b-a037-d35524b07d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c39d11-06a7-481d-aec8-73ec8f4ab211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96c39d11-06a7-481d-aec8-73ec8f4ab211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0', 'volume_name': 'volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c4f8a4-7136-4a14-abfd-ec02df8114b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c4f8a4-7136-4a14-abfd-ec02df8114b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd5af8-f9a2-48b1-a469-f36ab0b73d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:44 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Volume 7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0', 'volume_size': 1} Apr 10 18:30:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:46 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28" returned: 0 in 2.033s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:46 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d896d9-1efc-4652-a5d5-ec7e345ad867]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:46 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:46 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:47 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.594s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:30:47 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Converted 1024.00 MB image at 503.37 MB/s Apr 10 18:30:47 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 is being set with open permissions: ugo+rw Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:47 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 Apr 10 18:30:47 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:47 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28" returned: 0 in 0.415s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-e1d2717a-d053-4156-91fd-0bcfa57e6c28" released by "_copy_volume_from_snapshot" :: held 4.114s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-2dc296e2-e589-4968-92fe-4ca35e7cb558-e1d2717a-d053-4156-91fd-0bcfa57e6c28" released by "_create_volume_from_snapshot" :: held 4.133s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.153s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.444s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Creating offline snapshot 6f944efa-c474-4e46-afeb-8f914192295f of volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee3ad22-e598-40c2-9c59-0d9862943736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28', 'volume_size': 1, 'snapshot_id': '2dc296e2-e589-4968-92fe-4ca35e7cb558'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465c5d42-a45a-4c5a-b995-9074c3c24704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45d611b-cf35-453b-839a-ac2a2c358243]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Volume volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 (e1d2717a-d053-4156-91fd-0bcfa57e6c28): created successfully Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465c5d42-a45a-4c5a-b995-9074c3c24704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Flow 'volume_create_manager' (f87e2289-4819-4845-b31b-3e5cde69d54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:47 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-4736cb12-7eeb-4706-afee-b8acec220a3e tempest-VolumesSnapshotTestJSON-1968261558 None] Created volume successfully. Apr 10 18:30:47 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:47 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:48 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.464s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:48 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f 1G Apr 10 18:30:48 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:48 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f 1G" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:48 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f Apr 10 18:30:48 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-e1d2717a-d053-4156-91fd-0bcfa57e6c28-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-e1d2717a-d053-4156-91fd-0bcfa57e6c28-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-e1d2717a-d053-4156-91fd-0bcfa57e6c28" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-e1d2717a-d053-4156-91fd-0bcfa57e6c28" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae2c8db-e783-4fc1-930e-506a6bed2262]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:48 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 Apr 10 18:30:48 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:49 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:49 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f is being set with open permissions: ugo+rw Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:49 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f Apr 10 18:30:49 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:49 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:49 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28 Apr 10 18:30:49 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:49 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f" returned: 0 in 0.429s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=137,cinder:INSERT=35,cinder:UPDATE=139,cinder:DELETE=16 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=123,cinder:INSERT=33,cinder:UPDATE=144,cinder:DELETE=11 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.573s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-874714974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:45Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Creating volume 7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:49 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:49 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 1073741824 Apr 10 18:30:49 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:49 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7971b59a-73cc-41f6-a9f6-aea5d699648b tempest-VolumesSnapshotListTestJSON-1053123739 None] Create snapshot completed successfully Apr 10 18:30:49 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e1d2717a-d053-4156-91fd-0bcfa57e6c28" returned: 0 in 0.424s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-e1d2717a-d053-4156-91fd-0bcfa57e6c28" released by "delete_volume" :: held 0.939s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['a84b2f5c-b1e2-4783-90dd-91d3a4d5a9d2', '1b42a7c8-a006-4f96-9805-c0c514889452', 'ea1b40f7-964f-45bd-965e-ae4b590ac3f2', 'e9b64737-ff2a-49d1-81d3-e7c9bb93460b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:49 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:49 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-2dc296e2-e589-4968-92fe-4ca35e7cb558-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-2dc296e2-e589-4968-92fe-4ca35e7cb558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-155ee3fb-58ca-410a-b5fb-cc8e755031fb" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-155ee3fb-58ca-410a-b5fb-cc8e755031fb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-2dc296e2-e589-4968-92fe-4ca35e7cb558" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-2dc296e2-e589-4968-92fe-4ca35e7cb558" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Deleting offline snapshot 2dc296e2-e589-4968-92fe-4ca35e7cb558 of volume 155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] snapshot_file for this snap is: volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680732e-a6ff-4b83-bc96-735cd163886d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:49 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 Apr 10 18:30:49 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:49 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 1073741824" returned: 0 in 0.501s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:50 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 Apr 10 18:30:50 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:50 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.491s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Deleted volume successfully. Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-759a7e3e-c3ed-40f8-a0a4-feded5edc412 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-e1d2717a-d053-4156-91fd-0bcfa57e6c28-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:50 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558" returned: 0 in 0.536s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce121bdc-9815-4300-8f37-0c2ef46cf206]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:50 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:50 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:50 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd5af8-f9a2-48b1-a469-f36ab0b73d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2adf2cf-80f6-4edb-837f-239f912c1b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:50 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Volume volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 (7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0): created successfully Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2adf2cf-80f6-4edb-837f-239f912c1b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (05dd8dbf-d9f7-425d-9ee9-329eea788856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d261a03c-3e76-4ad8-bff3-179b02192bdd tempest-VolumesActionsTest-1060394911 None] Created volume successfully. Apr 10 18:30:50 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:50 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 Apr 10 18:30:50 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-6f944efa-c474-4e46-afeb-8f914192295f-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-6f944efa-c474-4e46-afeb-8f914192295f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-6f944efa-c474-4e46-afeb-8f914192295f" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-6f944efa-c474-4e46-afeb-8f914192295f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Deleting offline snapshot 6f944efa-c474-4e46-afeb-8f914192295f of volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] snapshot_file for this snap is: volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8a3318-281b-4991-af2d-fba3e2c37303]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:51 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f Apr 10 18:30:51 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Lock "cinder-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-quobyte-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0" acquired by "delete_volume" :: waited 0.025s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:51 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547edc5-2910-4be8-91eb-81183a428747]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:51 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558 Apr 10 18:30:51 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:51 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 Apr 10 18:30:51 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:51 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[debf9871-2ee3-4b39-bacf-56d09df1fb89]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:51 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:51 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:51 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb.2dc296e2-e589-4968-92fe-4ca35e7cb558" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-2dc296e2-e589-4968-92fe-4ca35e7cb558" released by "_delete_snapshot" :: held 2.001s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-155ee3fb-58ca-410a-b5fb-cc8e755031fb" released by "delete_snapshot" :: held 2.015s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['81dabb6d-c050-4b70-a949-5ad1541a8910', 'aeb92e2d-42eb-4c31-a324-7c730dcc59ef', 'c074f1e7-cfa8-4322-bf09-bbb423638b02', '517d8569-61cf-4678-82b4-85a2daeadae9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:51 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0" returned: 0 in 0.488s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:51 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0 Apr 10 18:30:51 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:51 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Delete snapshot completed successfully. Apr 10 18:30:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-444892ab-a771-4fb2-85dc-32b93a772be7 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-2dc296e2-e589-4968-92fe-4ca35e7cb558-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:52 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.506s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:52 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f Apr 10 18:30:52 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:52 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0" released by "delete_volume" :: held 0.946s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Created reservations ['d92e2bbf-dc84-4b98-b1e6-8ba93b2bb1d2', 'd23ccf7f-2c8f-4193-87b4-8a1001563aa9', '590a79d5-7e30-420b-877d-4d78ad950e2c', '41b8627c-c7f8-4eda-963f-4ee544b52d08'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:52 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:52 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (d5bf83e2-d162-457d-8b5b-21a741fd7e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e32f45d-8ac4-4155-ac54-df8f60e1a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e32f45d-8ac4-4155-ac54-df8f60e1a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-723578514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbeaa38-1eed-43bd-9c86-1b77142e81d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:53Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e48bc6e-6631-4b78-852e-c2d0c96be285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e48bc6e-6631-4b78-852e-c2d0c96be285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb81f11-3d89-4edd-ab89-6ffd3dc0e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb81f11-3d89-4edd-ab89-6ffd3dc0e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbbeaa38-1eed-43bd-9c86-1b77142e81d5', 'volume_name': 'volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6018a7ce-b2d1-4649-ac6d-ea19a558d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6018a7ce-b2d1-4649-ac6d-ea19a558d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7407a8d9-d554-4856-82ac-73d9c3fb0fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:52 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Volume fbbeaa38-1eed-43bd-9c86-1b77142e81d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5', 'volume_size': 1} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-723578514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbeaa38-1eed-43bd-9c86-1b77142e81d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:53Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Creating volume fbbeaa38-1eed-43bd-9c86-1b77142e81d5 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:52 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:52 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f" returned: 0 in 0.561s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:52 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 1073741824 Apr 10 18:30:52 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:52 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f Apr 10 18:30:52 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:52 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.464s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Deleted volume successfully. Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-63e1bcb7-a179-4eda-8644-052bcf71d469 tempest-VolumesActionsTest-401695264 None] Lock "cinder-7d8a069a-70d3-47eb-9ef6-d3414f8aa0a0-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-155ee3fb-58ca-410a-b5fb-cc8e755031fb-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-155ee3fb-58ca-410a-b5fb-cc8e755031fb-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-155ee3fb-58ca-410a-b5fb-cc8e755031fb" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-155ee3fb-58ca-410a-b5fb-cc8e755031fb" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e9e4c-19c2-4ad6-a5a6-125de179b6df]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:53 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:53 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:53 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.6f944efa-c474-4e46-afeb-8f914192295f" returned: 0 in 0.482s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-6f944efa-c474-4e46-afeb-8f914192295f" released by "_delete_snapshot" :: held 2.110s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" released by "delete_snapshot" :: held 2.119s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Created reservations ['1df22b28-e1ff-4efa-a4fe-96dd1cba92fd', '1b7092b4-9da8-4cf4-9d00-b6b52ded8098', '076e6e88-6370-4aed-aac2-832c3ba3922a', '0d8adaac-afbc-4a20-a6d5-8ccddae07e63'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:53 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 1073741824" returned: 0 in 0.573s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:53 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Delete snapshot completed successfully. Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9344bc55-a401-449c-bb06-8ea11c27900d tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-6f944efa-c474-4e46-afeb-8f914192295f-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:53 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 Apr 10 18:30:53 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:53 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:53 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb Apr 10 18:30:53 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:53 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5" returned: 0 in 0.418s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7407a8d9-d554-4856-82ac-73d9c3fb0fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7111568-a7c5-473a-b3cf-b2d0978fac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:53 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Volume volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 (fbbeaa38-1eed-43bd-9c86-1b77142e81d5): created successfully Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7111568-a7c5-473a-b3cf-b2d0978fac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (d5bf83e2-d162-457d-8b5b-21a741fd7e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:53 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-311727c3-bcc8-4c33-86fc-46829ada93dd tempest-VolumesActionsTest-1060394911 None] Created volume successfully. Apr 10 18:30:53 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-155ee3fb-58ca-410a-b5fb-cc8e755031fb" returned: 0 in 0.414s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-155ee3fb-58ca-410a-b5fb-cc8e755031fb" released by "delete_volume" :: held 0.969s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['8051a128-c1c3-4a6f-b3b0-82773f06ccac', '109dfdb7-c52f-4ed8-95df-02f102a71d09', '7262f463-62e0-49a3-b87b-c37d6e71de48', '58ed87e7-8101-4660-983d-78a46ccde812'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:54 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:54 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-7cdb9197-1f05-4610-89a2-318fc027c14c-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-7cdb9197-1f05-4610-89a2-318fc027c14c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "cinder-quobyte-7cdb9197-1f05-4610-89a2-318fc027c14c" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7cdb9197-1f05-4610-89a2-318fc027c14c" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d30ebfd-4295-4b79-bc56-6390896774ba]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-0b8b64a5-1268-48a3-bf2f-7bf1ddad4296-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-0b8b64a5-1268-48a3-bf2f-7bf1ddad4296-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Deleting offline snapshot 0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 of volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] snapshot_file for this snap is: volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ae184d-3149-4f1b-8889-9bc8bbc9b53a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:54 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c Apr 10 18:30:54 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:54 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:54 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:54 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.472s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Deleted volume successfully. Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-cd267214-2c8e-4200-8548-f3274f565e8f tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-155ee3fb-58ca-410a-b5fb-cc8e755031fb-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:54 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c" returned: 0 in 0.521s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:54 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c Apr 10 18:30:54 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:54 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442f5b8-b068-4ae7-bb51-f77494fa2a99]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:54 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:54 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-fbbeaa38-1eed-43bd-9c86-1b77142e81d5-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Lock "cinder-fbbeaa38-1eed-43bd-9c86-1b77142e81d5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-quobyte-fbbeaa38-1eed-43bd-9c86-1b77142e81d5" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-fbbeaa38-1eed-43bd-9c86-1b77142e81d5" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6cb2de-d57b-4d16-9d60-9068dc4abf23]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:55 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 Apr 10 18:30:55 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:55 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7cdb9197-1f05-4610-89a2-318fc027c14c" returned: 0 in 0.501s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-quobyte-7cdb9197-1f05-4610-89a2-318fc027c14c" released by "delete_volume" :: held 1.061s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Created reservations ['df52f98f-c167-424c-a97e-b353876b60df', '757ca629-fe4e-422b-a74e-b2dce443011f', 'eaaeaac2-5003-4f31-b5c9-fd0d0681cb67', '275fc01a-798a-41a3-8e4a-49fab1b77d79'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:55 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.551s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:55 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:55 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:55 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:55 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:55 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:55 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5 Apr 10 18:30:55 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:55 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.426s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:55 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Deleted volume successfully. Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6d2a4dfb-ae59-4d56-b0a2-7dd8c80971d8 tempest-VolumesSnapshotTestJSON-1968261558 None] Lock "cinder-7cdb9197-1f05-4610-89a2-318fc027c14c-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:55 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.471s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:55 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296 Apr 10 18:30:55 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:55 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-fbbeaa38-1eed-43bd-9c86-1b77142e81d5" returned: 0 in 0.441s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-fbbeaa38-1eed-43bd-9c86-1b77142e81d5" released by "delete_volume" :: held 0.983s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Created reservations ['c56216eb-9132-499d-9847-50217d66200b', '304f2d2f-9710-441f-8ea6-52c379782371', '0c61f803-5170-4b45-9e79-9f4aefecb8c9', '77d1300d-aa27-4c64-8090-19d01f5fbefa'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:56 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:56 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:56 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-0b8b64a5-1268-48a3-bf2f-7bf1ddad4296" released by "_delete_snapshot" :: held 2.006s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" released by "delete_snapshot" :: held 2.027s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (4510ff5f-2f30-44f9-9474-ed3de6cef3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb414651-f45e-49ce-a8f4-e7d729c9db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb414651-f45e-49ce-a8f4-e7d729c9db92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257403578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e64da1-a1de-4ee4-90c4-8c7c30db9e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:56Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d37e5b-fac1-4e0b-b318-687477ed27a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d37e5b-fac1-4e0b-b318-687477ed27a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cafdc0c-abf9-42d7-81d2-900c1dbd67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cafdc0c-abf9-42d7-81d2-900c1dbd67bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e64da1-a1de-4ee4-90c4-8c7c30db9e99', 'volume_name': 'volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0735b48b-4ffb-4a60-843f-fb6c3a9f03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0735b48b-4ffb-4a60-843f-fb6c3a9f03a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c2ccb9-ce97-489a-835b-622962277fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:56 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Volume 90e64da1-a1de-4ee4-90c4-8c7c30db9e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99', 'volume_size': 1} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257403578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e64da1-a1de-4ee4-90c4-8c7c30db9e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:30:56Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Creating volume 90e64da1-a1de-4ee4-90c4-8c7c30db9e99 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:30:56 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:56 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 1073741824 Apr 10 18:30:56 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Created reservations ['d0a61c68-0478-43c4-8dfa-d550c2a8dc73', 'c6510531-f372-4712-bacb-a002d743cb92', 'f817cdc3-2d9f-49a8-990e-3f98817671e0', 'caf674a6-1db5-4f11-a90b-859a8925ce1f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:56 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Delete snapshot completed successfully. Apr 10 18:30:56 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.471s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-60f0e335-278c-48d1-99a8-bf13a6714105 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-0b8b64a5-1268-48a3-bf2f-7bf1ddad4296-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:56 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Deleted volume successfully. Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c38f06a9-39e7-4703-b122-b27417ae7ddd tempest-VolumesActionsTest-401695264 None] Lock "cinder-fbbeaa38-1eed-43bd-9c86-1b77142e81d5-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:56 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 1073741824" returned: 0 in 0.579s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:56 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 Apr 10 18:30:56 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Deleting offline snapshot 8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a of volume 698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] snapshot_file for this snap is: volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:30:57 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99" returned: 0 in 0.480s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[383a38d2-b202-4d5c-afac-9642e76cce6d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c2ccb9-ce97-489a-835b-622962277fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab81f83-fbf0-4547-9924-6feb546dc281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:57 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Volume volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 (90e64da1-a1de-4ee4-90c4-8c7c30db9e99): created successfully Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab81f83-fbf0-4547-9924-6feb546dc281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (4510ff5f-2f30-44f9-9474-ed3de6cef3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:30:57 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-cd5e3115-7260-401a-8e77-b0ee5d9e438a tempest-VolumesActionsTest-1060394911 None] Created volume successfully. Apr 10 18:30:57 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:57 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:57 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-698986a9-ce48-41e0-8375-56cb793b2db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:30:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37268a0-eca8-4114-ae9c-b456e2a82777]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:58 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 Apr 10 18:30:58 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-90e64da1-a1de-4ee4-90c4-8c7c30db9e99-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Lock "cinder-90e64da1-a1de-4ee4-90c4-8c7c30db9e99-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-quobyte-90e64da1-a1de-4ee4-90c4-8c7c30db9e99" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-90e64da1-a1de-4ee4-90c4-8c7c30db9e99" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a58571-8710-4c3d-b3b7-b31c187726b7]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:58 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3" returned: 0 in 0.659s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:58 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 Apr 10 18:30:58 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:58 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:58 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:59 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99" returned: 0 in 0.577s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:59 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99 Apr 10 18:30:59 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:59 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:59 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a Apr 10 18:30:59 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:59 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-90e64da1-a1de-4ee4-90c4-8c7c30db9e99" returned: 0 in 0.482s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-90e64da1-a1de-4ee4-90c4-8c7c30db9e99" released by "delete_volume" :: held 1.081s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:59 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3.8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a" released by "_delete_snapshot" :: held 2.248s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" released by "delete_snapshot" :: held 2.268s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Created reservations ['2381f21b-1fcf-4b66-9559-e8f49cb89c10', 'f673b0d0-7682-4a74-bb9a-b0748c8dbf12', '37f2cb3a-700c-4f76-9cbf-c2096846e8b2', 'ec47b645-ff79-4fe7-8274-156606d839b0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Created reservations ['a76ed85d-bdaa-4454-bcac-c645bf020ff3', '1aeadb82-0242-4864-bafa-608b5ca7c01b', 'cb505c58-22fd-4b4c-b33a-bf6da33ecd83', '4b4d9c15-12db-4fb5-b0c5-8817af4e55f7'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:30:59 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:30:59 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:30:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Delete snapshot completed successfully. Apr 10 18:30:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-350945c8-6078-4a9f-a4a4-a03abf22652c tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-8d1fbe33-2264-4f10-84ca-f20aa6a2cd4a-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (615b0852-f351-4ca1-9ed2-4b7cf77d81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95691dd-2f53-4151-afa6-997cb13952d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95691dd-2f53-4151-afa6-997cb13952d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180320655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879c6072-e709-4678-b432-ede773640741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:00Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2ccc61-9359-4fe9-9a93-7a1a22f185e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2ccc61-9359-4fe9-9a93-7a1a22f185e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad2971e-31ca-4223-bcc1-ff4f233c504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad2971e-31ca-4223-bcc1-ff4f233c504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879c6072-e709-4678-b432-ede773640741', 'volume_name': 'volume-879c6072-e709-4678-b432-ede773640741', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5756e-3b94-4475-be42-798354e896b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5756e-3b94-4475-be42-798354e896b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e20ce87-ae9f-49fd-92e4-d707a2ae1c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume 879c6072-e709-4678-b432-ede773640741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879c6072-e709-4678-b432-ede773640741', 'volume_size': 1} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-180320655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879c6072-e709-4678-b432-ede773640741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:00Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Creating volume 879c6072-e709-4678-b432-ede773640741 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:00 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:00 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 1073741824 Apr 10 18:31:00 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:00 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:00 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Deleted volume successfully. Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-47997179-38a9-413b-890d-7345e59b68eb tempest-VolumesActionsTest-401695264 None] Lock "cinder-90e64da1-a1de-4ee4-90c4-8c7c30db9e99-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-698986a9-ce48-41e0-8375-56cb793b2db3-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-698986a9-ce48-41e0-8375-56cb793b2db3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78433d4-6034-43af-aab0-10d3b54c8523]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:00 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 1073741824" returned: 0 in 0.550s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:00 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 Apr 10 18:31:00 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:00 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 Apr 10 18:31:00 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (b60626cc-345f-43b9-92bb-1900a7a908cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52125330-9617-4787-9014-384a43792057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52125330-9617-4787-9014-384a43792057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1019959358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b805e525-5f29-4b6e-bf37-05eb94638a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:01Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4543d6-2f26-4aaa-b68c-c8b074883264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4543d6-2f26-4aaa-b68c-c8b074883264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b211a99-6ab0-41d6-aa34-6f37e5461930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b211a99-6ab0-41d6-aa34-6f37e5461930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b805e525-5f29-4b6e-bf37-05eb94638a37', 'volume_name': 'volume-b805e525-5f29-4b6e-bf37-05eb94638a37', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6d58ad-68f7-46e1-8f57-0f1fc9fa8491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6d58ad-68f7-46e1-8f57-0f1fc9fa8491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7568c758-0ca3-4b53-b5cb-68908d020281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Volume b805e525-5f29-4b6e-bf37-05eb94638a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b805e525-5f29-4b6e-bf37-05eb94638a37', 'volume_size': 1} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:01 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:01 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741" returned: 0 in 0.464s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.212s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1019959358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b805e525-5f29-4b6e-bf37-05eb94638a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:01Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Creating volume b805e525-5f29-4b6e-bf37-05eb94638a37 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:01 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3 Apr 10 18:31:01 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:01 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e20ce87-ae9f-49fd-92e4-d707a2ae1c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879c6072-e709-4678-b432-ede773640741', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae9d5da-9ef6-4ffb-a9cc-0b3bd465fcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:01 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 1073741824 Apr 10 18:31:01 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume volume-879c6072-e709-4678-b432-ede773640741 (879c6072-e709-4678-b432-ede773640741): created successfully Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae9d5da-9ef6-4ffb-a9cc-0b3bd465fcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (615b0852-f351-4ca1-9ed2-4b7cf77d81cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-330d9403-fbb9-4c2d-816b-2f6d626356c2 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created volume successfully. Apr 10 18:31:01 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-698986a9-ce48-41e0-8375-56cb793b2db3" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-quobyte-698986a9-ce48-41e0-8375-56cb793b2db3" released by "delete_volume" :: held 0.993s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Created reservations ['49e19c7f-0702-4d97-96eb-49d374610da3', 'f2de790f-87c0-4aef-b9e5-22bbd7fe76e3', '81e38f03-6348-4f2e-b27b-c7b473d37d25', '49c5d632-9344-4469-9c95-6c4610d8ad8c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:01 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 1073741824" returned: 0 in 0.497s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:01 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:01 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:01 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 Apr 10 18:31:01 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:02 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.424s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Deleted volume successfully. Apr 10 18:31:02 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37" returned: 0 in 0.417s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7568c758-0ca3-4b53-b5cb-68908d020281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b805e525-5f29-4b6e-bf37-05eb94638a37', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e25da49-db6d-4220-8235-1dee19612247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Volume volume-b805e525-5f29-4b6e-bf37-05eb94638a37 (b805e525-5f29-4b6e-bf37-05eb94638a37): created successfully Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e25da49-db6d-4220-8235-1dee19612247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (b60626cc-345f-43b9-92bb-1900a7a908cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc67e226-6e7a-4a3e-a139-f6a5aa68c258 tempest-VolumesSnapshotListTestJSON-1053123739 None] Lock "cinder-698986a9-ce48-41e0-8375-56cb793b2db3-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-77059945-2375-478c-918b-4d1a15eacf41 tempest-VolumesActionsTest-1060394911 None] Created volume successfully. Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (372515ab-855c-4a01-9ae6-dba169db2d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d08b8c-cf1c-45c4-a2db-7d9134cb9f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d08b8c-cf1c-45c4-a2db-7d9134cb9f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789165304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3a700c-e035-4c76-b0d6-6e2ef873e1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:02Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399dd675-4d47-48e4-8517-c20b2b2ea291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399dd675-4d47-48e4-8517-c20b2b2ea291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e12914-5c04-4d8e-82d2-657759d73749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e12914-5c04-4d8e-82d2-657759d73749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3a700c-e035-4c76-b0d6-6e2ef873e1ab', 'volume_name': 'volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63413a91-1455-4117-a560-466734878ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63413a91-1455-4117-a560-466734878ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea35b49-3a00-4928-8acb-fa567ac28bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume 6e3a700c-e035-4c76-b0d6-6e2ef873e1ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab', 'volume_size': 1} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789165304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3a700c-e035-4c76-b0d6-6e2ef873e1ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:02Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Creating volume 6e3a700c-e035-4c76-b0d6-6e2ef873e1ab {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:02 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab 1073741824 Apr 10 18:31:02 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (9a058a70-1eb7-4648-b9f5-fc6208021a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936dfa3d-f2a2-476f-8f5c-28ebf591a47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936dfa3d-f2a2-476f-8f5c-28ebf591a47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855252237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4a3f2d-6d79-42ec-913c-4c6814362229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce854f4-809e-42e4-8bd6-450743e64983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce854f4-809e-42e4-8bd6-450743e64983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee3aa2f-1629-4e4d-b299-f2799ebf98df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee3aa2f-1629-4e4d-b299-f2799ebf98df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca4a3f2d-6d79-42ec-913c-4c6814362229', 'volume_name': 'volume-ca4a3f2d-6d79-42ec-913c-4c6814362229', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e4f20f-892d-4460-8f78-16394d53f65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e4f20f-892d-4460-8f78-16394d53f65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5ee159-9af8-4978-ab23-492dc6cd789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume ca4a3f2d-6d79-42ec-913c-4c6814362229: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca4a3f2d-6d79-42ec-913c-4c6814362229', 'volume_size': 1} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (23511d6a-922c-4217-b014-f94e719030e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a80a926-83d8-442d-b89d-f7d63eb9a2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a80a926-83d8-442d-b89d-f7d63eb9a2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884814326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de28207-29a2-45bd-98ea-d26635bf2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de28207-29a2-45bd-98ea-d26635bf2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48857d0f-5d33-4819-8c36-874052a2a612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48857d0f-5d33-4819-8c36-874052a2a612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd', 'volume_name': 'volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0000642f-b883-4351-9a40-3526de15f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0000642f-b883-4351-9a40-3526de15f24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ca6b00-e4a0-4810-873a-bca235414c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume 9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd', 'volume_size': 1} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (01a5c615-4b7c-4815-ab16-fef1c1742c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6310d1c6-22cf-4b31-a08e-6e89ba521c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6310d1c6-22cf-4b31-a08e-6e89ba521c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985962122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865fd216-d225-4e23-ab12-8c5d69f63f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bf48a0-594b-4bf4-ae95-8b72bdfc758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13bf48a0-594b-4bf4-ae95-8b72bdfc758e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daed011-6fb4-4203-9909-4a67819fab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daed011-6fb4-4203-9909-4a67819fab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865fd216-d225-4e23-ab12-8c5d69f63f5b', 'volume_name': 'volume-865fd216-d225-4e23-ab12-8c5d69f63f5b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604335dd-d5dc-4bc8-8108-e81b924fe297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604335dd-d5dc-4bc8-8108-e81b924fe297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c27e2b3-3eb7-4560-9bf0-69e6a2369251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume 865fd216-d225-4e23-ab12-8c5d69f63f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865fd216-d225-4e23-ab12-8c5d69f63f5b', 'volume_size': 1} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:03 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab 1073741824" returned: 0 in 0.598s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:03 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab Apr 10 18:31:03 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-b805e525-5f29-4b6e-bf37-05eb94638a37-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Lock "cinder-b805e525-5f29-4b6e-bf37-05eb94638a37-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (b22e1e9e-fdc5-4278-aeb6-7f7c99b2a33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7181d3-77b9-4d66-85a5-27adcf01c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7181d3-77b9-4d66-85a5-27adcf01c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845990200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd0cf85-5ada-4684-ba4b-d4c00ab901b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cfcf30-ac16-4046-845e-a602379fe7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cfcf30-ac16-4046-845e-a602379fe7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb90d10-d042-465d-9958-f72f25ee3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb90d10-d042-465d-9958-f72f25ee3828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd0cf85-5ada-4684-ba4b-d4c00ab901b7', 'volume_name': 'volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f030b70a-bb35-456c-a1d6-60ce00a07d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f030b70a-bb35-456c-a1d6-60ce00a07d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47798b2-8c5f-4459-8dba-63f2fdd57814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume cbd0cf85-5ada-4684-ba4b-d4c00ab901b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7', 'volume_size': 1} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Acquiring lock "cinder-quobyte-b805e525-5f29-4b6e-bf37-05eb94638a37" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-b805e525-5f29-4b6e-bf37-05eb94638a37" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bb790a-f12c-44b2-b02c-85a2a27ef49b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:03 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 Apr 10 18:31:03 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:03 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab" returned: 0 in 0.490s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855252237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4a3f2d-6d79-42ec-913c-4c6814362229,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Creating volume ca4a3f2d-6d79-42ec-913c-4c6814362229 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:03 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea35b49-3a00-4928-8acb-fa567ac28bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4f5434-e998-416c-9f69-290420719e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab (6e3a700c-e035-4c76-b0d6-6e2ef873e1ab): created successfully Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4f5434-e998-416c-9f69-290420719e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:03 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 1073741824 Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (372515ab-855c-4a01-9ae6-dba169db2d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:03 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-30e2c43b-a43e-43d3-b368-b79093f68b3b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created volume successfully. Apr 10 18:31:03 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:03 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37 Apr 10 18:31:03 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:04 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 1073741824" returned: 0 in 0.587s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:04 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 Apr 10 18:31:04 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:04 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b805e525-5f29-4b6e-bf37-05eb94638a37" returned: 0 in 0.489s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Lock "cinder-quobyte-b805e525-5f29-4b6e-bf37-05eb94638a37" released by "delete_volume" :: held 1.031s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Created reservations ['cf1e6c03-ca4a-4d9a-8502-dca1c71ed5d4', 'ecc61ed1-6749-47dd-abb6-8a0e5a41c437', '3a7c17cf-9ac7-4334-b002-4022df23f81c', '0fda92a5-0b82-4dc2-9ed1-3922cbd585cf'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:04 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:04 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:04 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229" returned: 0 in 0.486s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1884814326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Creating volume 9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:04 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5ee159-9af8-4978-ab23-492dc6cd789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4a3f2d-6d79-42ec-913c-4c6814362229', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a07de90-06d3-4a42-b8de-dc8bde6f2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:04 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd 1073741824 Apr 10 18:31:04 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 (ca4a3f2d-6d79-42ec-913c-4c6814362229): created successfully Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a07de90-06d3-4a42-b8de-dc8bde6f2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (9a058a70-1eb7-4648-b9f5-fc6208021a99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6424a0a2-2684-473f-a52e-cc2b6122fd4e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created volume successfully. Apr 10 18:31:04 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.505s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Deleted volume successfully. Apr 10 18:31:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1291a63-9d1e-4aaf-8a68-4437b1a43387 tempest-VolumesActionsTest-401695264 None] Lock "cinder-b805e525-5f29-4b6e-bf37-05eb94638a37-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Flow 'volume_create_manager' (8340a988-67e9-40c3-838b-c6d3752b1e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fb53de-5871-4a5b-a291-d91ed435ebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3fb53de-5871-4a5b-a291-d91ed435ebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1941817636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1568f4f9-0550-47c2-93df-49426670d0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14ec51469c44761a29eba88de21edbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:05Z,use_quota=True,user_id='2e7a9a60ac4d47f88037f43a57667862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715963d4-3760-4634-8a90-1ca384ca3697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715963d4-3760-4634-8a90-1ca384ca3697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39125aa4-87e5-4ce2-a586-c241516c8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39125aa4-87e5-4ce2-a586-c241516c8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1568f4f9-0550-47c2-93df-49426670d0f8', 'volume_name': 'volume-1568f4f9-0550-47c2-93df-49426670d0f8', 'volume_size': 2}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7734288-c96e-416f-8796-dd4c3f724a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7734288-c96e-416f-8796-dd4c3f724a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e437207f-60e5-44f6-8c6a-a98b3991315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Volume 1568f4f9-0550-47c2-93df-49426670d0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1568f4f9-0550-47c2-93df-49426670d0f8', 'volume_size': 2} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:05 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd 1073741824" returned: 0 in 0.546s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:05 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd Apr 10 18:31:05 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (ed060046-7404-43cd-8af9-f5d5c2f9288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a025aca7-a38b-43e1-96dc-c389759e3df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a025aca7-a38b-43e1-96dc-c389759e3df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948921996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42ce32a-b4a4-4d18-835b-5b7ae957ccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:06Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c0d470-383c-4b15-ac61-fa0e40668eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c0d470-383c-4b15-ac61-fa0e40668eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66995646-a3c9-46d1-9be3-9e610f076a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66995646-a3c9-46d1-9be3-9e610f076a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42ce32a-b4a4-4d18-835b-5b7ae957ccf9', 'volume_name': 'volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff8bb2c-a057-45cc-800c-c568fd8ece2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff8bb2c-a057-45cc-800c-c568fd8ece2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50f3dff-d3a5-410d-9c0a-7ef2a3daaa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Volume d42ce32a-b4a4-4d18-835b-5b7ae957ccf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9', 'volume_size': 1} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:05 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.734s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-985962122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865fd216-d225-4e23-ab12-8c5d69f63f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Creating volume 865fd216-d225-4e23-ab12-8c5d69f63f5b {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:05 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:05 devstack sudo[88520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b 1073741824 Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ca6b00-e4a0-4810-873a-bca235414c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack sudo[88520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132ce374-39e7-4934-a65d-a0d4f0d961c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:05 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd (9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd): created successfully Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132ce374-39e7-4934-a65d-a0d4f0d961c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (23511d6a-922c-4217-b014-f94e719030e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:05 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ebbf4e7d-3362-47ec-b469-970c75847ff7 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created volume successfully. Apr 10 18:31:06 devstack sudo[88520]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b 1073741824" returned: 0 in 0.484s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:06 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b Apr 10 18:31:06 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:06 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b" returned: 0 in 0.439s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845990200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd0cf85-5ada-4684-ba4b-d4c00ab901b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d51cd0abfe4dfb9176f1f9509f93f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:03Z,use_quota=True,user_id='32939c6b9ee347ca8e4b0e34cb047968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Creating volume cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:06 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c27e2b3-3eb7-4560-9bf0-69e6a2369251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865fd216-d225-4e23-ab12-8c5d69f63f5b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:06 devstack sudo[88528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 1073741824 Apr 10 18:31:06 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6bd2e9-c63f-40ce-a1e2-254bd2443b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:06 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume volume-865fd216-d225-4e23-ab12-8c5d69f63f5b (865fd216-d225-4e23-ab12-8c5d69f63f5b): created successfully Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6bd2e9-c63f-40ce-a1e2-254bd2443b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (01a5c615-4b7c-4815-ab16-fef1c1742c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8c8c8ec2-a9b2-4b2f-97dc-dbaf99a43d4b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created volume successfully. Apr 10 18:31:07 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 1073741824" returned: 0 in 0.511s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:07 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 Apr 10 18:31:07 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:07 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7" returned: 0 in 0.441s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.660s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1941817636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1568f4f9-0550-47c2-93df-49426670d0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a14ec51469c44761a29eba88de21edbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:05Z,use_quota=True,user_id='2e7a9a60ac4d47f88037f43a57667862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Creating volume 1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:07 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 2147483648 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47798b2-8c5f-4459-8dba-63f2fdd57814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:07 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 2147483648 Apr 10 18:31:07 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb737559-cf26-4c17-8131-5d7aca2b4caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:07 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Volume volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 (cbd0cf85-5ada-4684-ba4b-d4c00ab901b7): created successfully Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb737559-cf26-4c17-8131-5d7aca2b4caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Flow 'volume_create_manager' (b22e1e9e-fdc5-4278-aeb6-7f7c99b2a33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2c155d3c-b3ba-4604-9851-7fe918f832aa tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created volume successfully. Apr 10 18:31:08 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 2147483648" returned: 0 in 0.515s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:08 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 Apr 10 18:31:08 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:08 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8" returned: 0 in 0.452s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.020s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948921996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42ce32a-b4a4-4d18-835b-5b7ae957ccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fadf6e588204cd8b132964428e10e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:06Z,use_quota=True,user_id='f2c952a8208c4e54b295e617a1f3a4a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Creating volume d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:08 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:08 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 1073741824 Apr 10 18:31:08 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e437207f-60e5-44f6-8c6a-a98b3991315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1568f4f9-0550-47c2-93df-49426670d0f8', 'volume_size': 2}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a57f60-9a87-4509-9854-b6925df7b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:08 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Volume volume-1568f4f9-0550-47c2-93df-49426670d0f8 (1568f4f9-0550-47c2-93df-49426670d0f8): created successfully Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a57f60-9a87-4509-9854-b6925df7b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Flow 'volume_create_manager' (8340a988-67e9-40c3-838b-c6d3752b1e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0cb1086d-a76b-4e06-a7c6-00a39d076008 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Created volume successfully. Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-quobyte-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6415595-a31a-4553-ac7d-b3a270116a86]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:08 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 Apr 10 18:31:08 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:09 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 1073741824" returned: 0 in 0.472s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:09 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 Apr 10 18:31:09 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:09 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:09 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7 Apr 10 18:31:09 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:09 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9" returned: 0 in 0.430s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.308s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50f3dff-d3a5-410d-9c0a-7ef2a3daaa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bf8aab-93c7-4b51-9559-abf9b7181ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Creating offline snapshot 90b4403d-7ce0-43a5-aa83-cfd45bac8f6c of volume 1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:31:09 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Volume volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 (d42ce32a-b4a4-4d18-835b-5b7ae957ccf9): created successfully Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bf8aab-93c7-4b51-9559-abf9b7181ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Flow 'volume_create_manager' (ed060046-7404-43cd-8af9-f5d5c2f9288a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f8dce8-0f22-4944-9f1c-00babf048316]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:09 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-12a70ef8-37ad-4636-b09e-b20673ce06f3 tempest-VolumesActionsTest-1060394911 None] Created volume successfully. Apr 10 18:31:09 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7" returned: 0 in 0.414s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7" released by "delete_volume" :: held 0.949s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:09 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 Apr 10 18:31:09 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created reservations ['59f78911-8a23-4a39-b6ee-c39691a36a84', '73c4fa4b-75a1-441c-817c-246a91c2846d', 'b68dabd0-c181-490a-b124-25bc852cde51', '22cf48e9-3e71-41bc-9a12-31de8414b155'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:09 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:09 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:10 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8" returned: 0 in 0.542s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c 2G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:10 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c 2G Apr 10 18:31:10 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "cinder-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "cinder-quobyte-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-quobyte-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415273a-f5f6-4c8b-9608-fcd46feb2586]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:10 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:10 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Deleted volume successfully. Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f9961359-ba90-45cc-bb32-0e8d640edc1e tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-cbd0cf85-5ada-4684-ba4b-d4c00ab901b7-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:10 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 Apr 10 18:31:10 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:10 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c 2G" returned: 0 in 0.508s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1568f4f9-0550-47c2-93df-49426670d0f8 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:10 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1568f4f9-0550-47c2-93df-49426670d0f8 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c Apr 10 18:31:10 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:10 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9" returned: 0 in 0.486s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:10 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9 Apr 10 18:31:10 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-865fd216-d225-4e23-ab12-8c5d69f63f5b-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-865fd216-d225-4e23-ab12-8c5d69f63f5b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-quobyte-865fd216-d225-4e23-ab12-8c5d69f63f5b" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-865fd216-d225-4e23-ab12-8c5d69f63f5b" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2772e26-d8aa-49fa-a251-a32aac027bb5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:11 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b Apr 10 18:31:11 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:11 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1568f4f9-0550-47c2-93df-49426670d0f8 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:11 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c is being set with open permissions: ugo+rw Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:11 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c Apr 10 18:31:11 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:11 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-quobyte-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9" released by "delete_volume" :: held 0.977s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Created reservations ['bdfe1cde-abff-45ba-a113-6b497289bc8e', '66bdbbab-2f01-4363-9024-8a27b0f5277f', '1ddd19f4-3adf-42b4-b7f6-fc143104c9bf', '2a1a960a-b5ea-495e-911b-0ad2736309c1'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:11 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:11 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:11 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b" returned: 0 in 0.513s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:11 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b Apr 10 18:31:11 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:11 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:11 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info Apr 10 18:31:11 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:11 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:11 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Deleted volume successfully. Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5cf1d3bb-4786-48bf-84e3-1a4c28483035 tempest-VolumesActionsTest-1060394911 None] Lock "cinder-d42ce32a-b4a4-4d18-835b-5b7ae957ccf9-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:11 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-865fd216-d225-4e23-ab12-8c5d69f63f5b" returned: 0 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-865fd216-d225-4e23-ab12-8c5d69f63f5b" released by "delete_volume" :: held 0.991s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:11 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created reservations ['9a9b7f7d-3985-49fd-93cb-b67ab0485159', 'b3f88c54-e4ce-4f66-a62f-24ebcc80d384', 'b3ae1a60-298e-470f-a0fe-c231b2a35bc5', '699c8d49-0ab4-478f-9991-5e05cb076ebe'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:12 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:12 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:12 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:12 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info is being set with open permissions: ugo+rw Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:12 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info Apr 10 18:31:12 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:12 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Deleted volume successfully. Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f88b362b-2e20-4964-8c28-aac1450d4dbc tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-865fd216-d225-4e23-ab12-8c5d69f63f5b-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:12 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.info" returned: 0 in 0.413s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.943s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6d0818f3-1ddb-4a59-9567-7bbe9ba3dd17 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Create snapshot completed successfully Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-quobyte-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af396a1-a563-44ef-8a70-34e25873aa57]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:13 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd Apr 10 18:31:13 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "cinder-90b4403d-7ce0-43a5-aa83-cfd45bac8f6c-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-90b4403d-7ce0-43a5-aa83-cfd45bac8f6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "cinder-quobyte-1568f4f9-0550-47c2-93df-49426670d0f8" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-quobyte-1568f4f9-0550-47c2-93df-49426670d0f8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "cinder-quobyte-90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-quobyte-90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Deleting offline snapshot 90b4403d-7ce0-43a5-aa83-cfd45bac8f6c of volume 1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] snapshot_file for this snap is: volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aa0e03-e86f-4056-bb18-d5b320ec43cd]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:13 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:13 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c Apr 10 18:31:13 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd" returned: 0 in 0.607s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:13 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd Apr 10 18:31:13 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:14 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" returned: 0 in 0.546s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1568f4f9-0550-47c2-93df-49426670d0f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cc872-1c3a-475a-b212-70c24cb6c90c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:14 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd" returned: 0 in 0.522s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd" released by "delete_volume" :: held 1.165s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:14 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 Apr 10 18:31:14 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created reservations ['80820f0c-3a9d-41fd-b9f8-9673f9c78dd8', 'f5a65637-0d74-42e0-8e85-a7849aa7d408', '2d5b28f5-1a2b-48ce-ba33-24593932b79c', '5915d163-8957-41f4-842c-4f96f3a5dad4'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:14 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:14 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:14 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:14 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c Apr 10 18:31:14 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:14 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:14 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Deleted volume successfully. Apr 10 18:31:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c8ae3728-10a6-40e4-b8cd-658993d18110 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-9f3be2ae-a2ca-45db-b4f8-04bfec12b3dd-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:15 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:15 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c Apr 10 18:31:15 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-ca4a3f2d-6d79-42ec-913c-4c6814362229-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-ca4a3f2d-6d79-42ec-913c-4c6814362229-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-quobyte-ca4a3f2d-6d79-42ec-913c-4c6814362229" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-ca4a3f2d-6d79-42ec-913c-4c6814362229" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f7ae7-709d-4272-ac3e-7d92b07c910d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:15 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 Apr 10 18:31:15 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:15 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8.90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-quobyte-90b4403d-7ce0-43a5-aa83-cfd45bac8f6c" released by "_delete_snapshot" :: held 2.101s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-quobyte-1568f4f9-0550-47c2-93df-49426670d0f8" released by "delete_snapshot" :: held 2.115s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Created reservations ['64ee0403-7fb2-4dc0-9a4b-850a93b3898d', 'd49f8125-a10c-4b4f-9906-83cfa0905e6a', 'f5e6fe52-8963-4dae-9773-92bf5296a224', '7cec295e-712d-4f32-8338-52ccc9649bd3'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:15 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Delete snapshot completed successfully. Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-789769c3-66df-42d4-bed4-04c732a91263 tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-90b4403d-7ce0-43a5-aa83-cfd45bac8f6c-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:15 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229" returned: 0 in 0.634s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:15 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229 Apr 10 18:31:15 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:16 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ca4a3f2d-6d79-42ec-913c-4c6814362229" returned: 0 in 0.488s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-ca4a3f2d-6d79-42ec-913c-4c6814362229" released by "delete_volume" :: held 1.160s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created reservations ['70c0db28-1205-4690-acc9-93b54f229050', '13bbf374-525b-4058-b2d5-c32069965963', '006945eb-2005-470e-913b-ca86506eea45', 'a3c9d2c1-0c5e-41c2-af09-99d5a32ecac1'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:16 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:16 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:16 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:16 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "cinder-1568f4f9-0550-47c2-93df-49426670d0f8-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-1568f4f9-0550-47c2-93df-49426670d0f8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "cinder-quobyte-1568f4f9-0550-47c2-93df-49426670d0f8" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-quobyte-1568f4f9-0550-47c2-93df-49426670d0f8" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22cd8a6-e009-4847-bf0f-039eb629ab4f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:17 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 Apr 10 18:31:17 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:17 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.526s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:17 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Deleted volume successfully. Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-682aa895-e149-4751-b0e4-b3016eccc8cd tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-ca4a3f2d-6d79-42ec-913c-4c6814362229-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:17 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.587s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:17 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8" returned: 0 in 0.621s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-quobyte-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:17 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8 Apr 10 18:31:17 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e3a6d2-855d-4387-afc3-3cf7fcc55776]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:17 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab Apr 10 18:31:17 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:18 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1568f4f9-0550-47c2-93df-49426670d0f8" returned: 0 in 0.498s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-quobyte-1568f4f9-0550-47c2-93df-49426670d0f8" released by "delete_volume" :: held 1.160s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Created reservations ['a8095656-64ed-42e0-a237-7bc24665521d', '0ffaec88-e823-4b36-ac7b-b602ab27199d', '68820862-9f46-4ad0-b234-8d6344f55f47', 'e3b8a2fa-450a-4f91-83d8-953203daeca3'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:18 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:18 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:18 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab" returned: 0 in 0.582s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:18 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab Apr 10 18:31:18 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:18 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Deleted volume successfully. Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7db11788-0a0f-4de4-9188-1a0f6923ef9a tempest-VolumesSnapshotNegativeTestJSON-781478926 None] Lock "cinder-1568f4f9-0550-47c2-93df-49426670d0f8-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:18 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab" returned: 0 in 0.523s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab" released by "delete_volume" :: held 1.127s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created reservations ['e361bd6d-1cf3-4eb5-80e8-3d04dd13f03b', '2711240d-2a8e-4d20-9257-2b09801b5799', 'dc8155f9-8553-46d1-95ae-e1571d529529', '52cd615a-c490-4e7d-b4f8-2222b924ef46'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:18 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:18 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:19 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.505s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Deleted volume successfully. Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-242e749f-5751-4e7b-889e-6604e6136847 tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-6e3a700c-e035-4c76-b0d6-6e2ef873e1ab-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-879c6072-e709-4678-b432-ede773640741-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-879c6072-e709-4678-b432-ede773640741-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "cinder-quobyte-879c6072-e709-4678-b432-ede773640741" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-879c6072-e709-4678-b432-ede773640741" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1b772-cfbb-4e24-91a5-8b41c36c3ec2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:19 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 Apr 10 18:31:19 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Flow 'volume_create_manager' (0af674c5-4feb-494b-bfbe-152188f3b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3134cb2d-6376-40fd-9339-cb83943d24ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3134cb2d-6376-40fd-9339-cb83943d24ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-668106229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d092f791-4ebd-410a-bbb3-fb2042c78651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee71bdcce08f45df9414df15525c7443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:20Z,use_quota=True,user_id='c9905592317b46fcb6ff7b3f85263160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf11737-9410-42a3-8568-553b8a520750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf11737-9410-42a3-8568-553b8a520750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c818a0a2-aade-4cc6-b55c-fc599df31c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.image.glance [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Creating Keystone auth plugin from conf {{(pid=82020) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 18:31:20 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741" returned: 0 in 0.607s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:20 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741 Apr 10 18:31:20 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c818a0a2-aade-4cc6-b55c-fc599df31c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd092f791-4ebd-410a-bbb3-fb2042c78651', 'volume_name': 'volume-d092f791-4ebd-410a-bbb3-fb2042c78651', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6a9868-7ee2-4b42-a2c3-b601c5ab9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6a9868-7ee2-4b42-a2c3-b601c5ab9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce9722c-0801-49d9-b0e5-27e7f9a2d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:20 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Volume d092f791-4ebd-410a-bbb3-fb2042c78651: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d092f791-4ebd-410a-bbb3-fb2042c78651', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Trying to clone d092f791-4ebd-410a-bbb3-fb2042c78651 from image efad70a4-2f7f-4812-890b-f0ef460d14cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]). {{(pid=82020) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 18:31:20 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Image download 20.69 MB at 20.69 MB/s Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbf6f63-6f11-4d90-ba0c-d0aa6f4e7c63]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:20 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-879c6072-e709-4678-b432-ede773640741" returned: 0 in 0.482s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-quobyte-879c6072-e709-4678-b432-ede773640741" released by "delete_volume" :: held 1.125s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:20 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD Apr 10 18:31:20 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Created reservations ['3621ceb7-2bac-4f61-a0fa-782a63280263', 'b8453b32-9101-40d0-9a76-4ea15b934e01', '7c0a4fcd-eea8-4b78-bb1a-c3abfbee883c', '5b9dc34e-8d81-4d26-b135-8a4d1c950347'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:20 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:20 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (c24405d2-16a9-4dd3-bdee-ecc0ac20b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd11d49-9b90-460d-a92d-683667918489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd11d49-9b90-460d-a92d-683667918489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318029137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8117d0a-9fea-4f50-a03a-068b53e86701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:21Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d9af33-e29d-49db-879f-e8a96b6f660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d9af33-e29d-49db-879f-e8a96b6f660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce0f6fd-e0a8-4ee1-b4f4-07598f5bbf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce0f6fd-e0a8-4ee1-b4f4-07598f5bbf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8117d0a-9fea-4f50-a03a-068b53e86701', 'volume_name': 'volume-a8117d0a-9fea-4f50-a03a-068b53e86701', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5397d5-d1e1-48ca-86f6-12d7260ab6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5397d5-d1e1-48ca-86f6-12d7260ab6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa945a06-a7c9-40d9-9e54-f932896c2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Volume a8117d0a-9fea-4f50-a03a-068b53e86701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8117d0a-9fea-4f50-a03a-068b53e86701', 'volume_size': 1} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318029137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8117d0a-9fea-4f50-a03a-068b53e86701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:21Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Creating volume a8117d0a-9fea-4f50-a03a-068b53e86701 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:21 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 1073741824 Apr 10 18:31:21 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (876d9620-f71a-405f-8816-d791092f1857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed900450-d088-4d9a-b07e-f5117ef4e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed900450-d088-4d9a-b07e-f5117ef4e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003509503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce03067e-4dda-46f8-8647-425e68b47b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:21Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649ed660-ea75-418c-addb-3b7c9853bcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649ed660-ea75-418c-addb-3b7c9853bcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33ae98-a2f3-4704-922d-c5adcef28f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a33ae98-a2f3-4704-922d-c5adcef28f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce03067e-4dda-46f8-8647-425e68b47b28', 'volume_name': 'volume-ce03067e-4dda-46f8-8647-425e68b47b28', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dc50d3-fe8b-43dd-bb69-8c9901e1d853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5dc50d3-fe8b-43dd-bb69-8c9901e1d853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee33e0be-14dc-4d7f-8230-effbfb3f8068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Volume ce03067e-4dda-46f8-8647-425e68b47b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce03067e-4dda-46f8-8647-425e68b47b28', 'volume_size': 1} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:21 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf is fetched for user c9905592317b46fcb6ff7b3f85263160. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (5cb31c5c-2d81-4d1e-ad7a-188af85e8d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ad081c-a3c6-466e-ab9e-0d42404217c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ad081c-a3c6-466e-ab9e-0d42404217c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1027503419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da44e30-5345-4de1-8ea5-f651f2178e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:21Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03dd69d4-761a-4dec-bbb4-11fb481a021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03dd69d4-761a-4dec-bbb4-11fb481a021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d9229b-f0f7-4d8b-bdd2-e3685db9b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d9229b-f0f7-4d8b-bdd2-e3685db9b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da44e30-5345-4de1-8ea5-f651f2178e2d', 'volume_name': 'volume-7da44e30-5345-4de1-8ea5-f651f2178e2d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e50d956-78f6-47a6-ab1f-8c98b6e4b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e50d956-78f6-47a6-ab1f-8c98b6e4b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049b3626-1f67-4ff9-abce-1fd677d95416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Volume 7da44e30-5345-4de1-8ea5-f651f2178e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da44e30-5345-4de1-8ea5-f651f2178e2d', 'volume_size': 1} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.680s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:21 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Deleted volume successfully. Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c518953-b1fe-4533-8f76-0cb078434e62]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 1073741824" returned: 0 in 0.591s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-785f5cec-7409-4f00-8dc1-37c4be096e2b tempest-CreateVolumesFromSourceVolumeTest-2064117584 None] Lock "cinder-879c6072-e709-4678-b432-ede773640741-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:21 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD Apr 10 18:31:21 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:21 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 Apr 10 18:31:21 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (214b99ea-2696-440e-8ad2-3c7b8b9f1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb5a621-bf49-40ad-94b2-4493a4d4dcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb5a621-bf49-40ad-94b2-4493a4d4dcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1109850040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db368c4d-3fe1-4341-910e-110266fd347f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:22Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc0de9-0f8c-4181-b56c-fe9003e3179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc0de9-0f8c-4181-b56c-fe9003e3179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7740cc-332e-4378-b9e8-ab6169f43fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7740cc-332e-4378-b9e8-ab6169f43fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db368c4d-3fe1-4341-910e-110266fd347f', 'volume_name': 'volume-db368c4d-3fe1-4341-910e-110266fd347f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6219fe4-6604-497f-b6db-4aa8446ad832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6219fe4-6604-497f-b6db-4aa8446ad832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5528ad3-e458-4fb2-a57d-c39acce156a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Volume db368c4d-3fe1-4341-910e-110266fd347f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db368c4d-3fe1-4341-910e-110266fd347f', 'volume_size': 1} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (4baa24b3-a187-407e-b1fb-471ad69487e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589e6345-7c1c-4214-8919-86d57fe19345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589e6345-7c1c-4214-8919-86d57fe19345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1191861899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39407da-937a-4c62-801a-ddf6adc2d318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:22Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a3f4bb-f07d-4649-9f8e-6d4e5b1d95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a3f4bb-f07d-4649-9f8e-6d4e5b1d95db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a01526-bb55-4997-af5b-d12e1ebcb700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17a01526-bb55-4997-af5b-d12e1ebcb700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39407da-937a-4c62-801a-ddf6adc2d318', 'volume_name': 'volume-f39407da-937a-4c62-801a-ddf6adc2d318', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc40f2-359c-4fe1-be35-1d2a600e907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fc40f2-359c-4fe1-be35-1d2a600e907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60080765-092e-46e8-9c42-bc797430f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Volume f39407da-937a-4c62-801a-ddf6adc2d318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39407da-937a-4c62-801a-ddf6adc2d318', 'volume_size': 1} Apr 10 18:31:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:22 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:22 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701" returned: 0 in 0.555s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.024s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003509503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce03067e-4dda-46f8-8647-425e68b47b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:21Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Creating volume ce03067e-4dda-46f8-8647-425e68b47b28 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:22 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa945a06-a7c9-40d9-9e54-f932896c2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8117d0a-9fea-4f50-a03a-068b53e86701', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2a1c84-3839-4cbd-b048-858e912c77a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:22 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 1073741824 Apr 10 18:31:22 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:22 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Volume volume-a8117d0a-9fea-4f50-a03a-068b53e86701 (a8117d0a-9fea-4f50-a03a-068b53e86701): created successfully Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2a1c84-3839-4cbd-b048-858e912c77a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (c24405d2-16a9-4dd3-bdee-ecc0ac20b720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:22 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-45017bf9-03c6-4f51-9148-52c3a609cd4d tempest-CreateVolumesFromImageTest-1870137779 None] Created volume successfully. Apr 10 18:31:22 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 1073741824" returned: 0 in 0.553s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:22 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 Apr 10 18:31:22 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:23 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1027503419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da44e30-5345-4de1-8ea5-f651f2178e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:21Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Creating volume 7da44e30-5345-4de1-8ea5-f651f2178e2d {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:23 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee33e0be-14dc-4d7f-8230-effbfb3f8068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce03067e-4dda-46f8-8647-425e68b47b28', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:23 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d 1073741824 Apr 10 18:31:23 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f20e9b4-a417-4394-b0d6-c430dec11955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:23 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Volume volume-ce03067e-4dda-46f8-8647-425e68b47b28 (ce03067e-4dda-46f8-8647-425e68b47b28): created successfully Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f20e9b4-a417-4394-b0d6-c430dec11955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (876d9620-f71a-405f-8816-d791092f1857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-69764d5d-435e-40fb-9457-eed41e1a1784 tempest-CreateVolumesFromImageTest-1870137779 None] Created volume successfully. Apr 10 18:31:23 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d 1073741824" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:23 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d Apr 10 18:31:23 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:24 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.412s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1109850040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db368c4d-3fe1-4341-910e-110266fd347f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:22Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Creating volume db368c4d-3fe1-4341-910e-110266fd347f {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:24 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049b3626-1f67-4ff9-abce-1fd677d95416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da44e30-5345-4de1-8ea5-f651f2178e2d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdef5433-6188-48dd-abbf-0b4e2498808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:24 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f 1073741824 Apr 10 18:31:24 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Volume volume-7da44e30-5345-4de1-8ea5-f651f2178e2d (7da44e30-5345-4de1-8ea5-f651f2178e2d): created successfully Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdef5433-6188-48dd-abbf-0b4e2498808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (5cb31c5c-2d81-4d1e-ad7a-188af85e8d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:24 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8803548f-4627-4ae7-a7c3-db5a3cded85e tempest-CreateVolumesFromImageTest-1870137779 None] Created volume successfully. Apr 10 18:31:24 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f 1073741824" returned: 0 in 0.505s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:24 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f Apr 10 18:31:24 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:25 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.213s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1191861899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f39407da-937a-4c62-801a-ddf6adc2d318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33faee98ac7740ebb17c3f23c11c90de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:22Z,use_quota=True,user_id='2a02b83b631c4c92b1afcd47775b2db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Creating volume f39407da-937a-4c62-801a-ddf6adc2d318 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:25 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5528ad3-e458-4fb2-a57d-c39acce156a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db368c4d-3fe1-4341-910e-110266fd347f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0363f11-7d6a-4795-9252-b58c98dfaf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:25 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 1073741824 Apr 10 18:31:25 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:25 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Volume volume-db368c4d-3fe1-4341-910e-110266fd347f (db368c4d-3fe1-4341-910e-110266fd347f): created successfully Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0363f11-7d6a-4795-9252-b58c98dfaf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (214b99ea-2696-440e-8ad2-3c7b8b9f1f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-4db1b5dd-a288-4cdb-9483-f3331304b844 tempest-CreateVolumesFromImageTest-1870137779 None] Created volume successfully. Apr 10 18:31:25 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 1073741824" returned: 0 in 0.523s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:25 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 Apr 10 18:31:25 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:26 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318" returned: 0 in 0.406s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.993s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-668106229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d092f791-4ebd-410a-bbb3-fb2042c78651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee71bdcce08f45df9414df15525c7443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:20Z,use_quota=True,user_id='c9905592317b46fcb6ff7b3f85263160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Creating volume d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:26 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60080765-092e-46e8-9c42-bc797430f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39407da-937a-4c62-801a-ddf6adc2d318', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b68fe01-4aaf-4d57-8313-0a32ab41a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:26 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 1073741824 Apr 10 18:31:26 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:26 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Volume volume-f39407da-937a-4c62-801a-ddf6adc2d318 (f39407da-937a-4c62-801a-ddf6adc2d318): created successfully Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b68fe01-4aaf-4d57-8313-0a32ab41a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Flow 'volume_create_manager' (4baa24b3-a187-407e-b1fb-471ad69487e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:26 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-83e48ba4-fde1-4099-98c9-ece5edfdc342 tempest-CreateVolumesFromImageTest-1870137779 None] Created volume successfully. Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-f39407da-937a-4c62-801a-ddf6adc2d318-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-f39407da-937a-4c62-801a-ddf6adc2d318-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-quobyte-f39407da-937a-4c62-801a-ddf6adc2d318" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-f39407da-937a-4c62-801a-ddf6adc2d318" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7356f42-50d2-4430-aebe-2af2f066df56]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:26 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 Apr 10 18:31:26 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:26 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 1073741824" returned: 0 in 0.536s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:26 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:26 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:26 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318" returned: 0 in 0.532s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:26 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318 Apr 10 18:31:26 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:27 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 0 in 0.441s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Attempting download of efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume d092f791-4ebd-410a-bbb3-fb2042c78651. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea86913d-d91e-4bc0-ab5a-c2c80247ff57]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:27 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j Apr 10 18:31:27 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:27 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f39407da-937a-4c62-801a-ddf6adc2d318" returned: 0 in 0.412s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-f39407da-937a-4c62-801a-ddf6adc2d318" released by "delete_volume" :: held 0.974s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Created reservations ['ce4ccc83-8148-4e52-97a4-af29a308cd6d', '54e197d8-ac80-4360-9b47-701a2e0301d6', '89bfe347-7d6d-40e0-bb8e-2e2bdef66bdb', '1644207d-a14e-46de-91f7-bb168d7a2b18'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:27 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:27 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-db368c4d-3fe1-4341-910e-110266fd347f-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-db368c4d-3fe1-4341-910e-110266fd347f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-quobyte-db368c4d-3fe1-4341-910e-110266fd347f" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-db368c4d-3fe1-4341-910e-110266fd347f" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d271702-e2eb-412e-8e8e-d2b29149e8b9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:27 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f Apr 10 18:31:27 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:27 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j" returned: 0 in 0.511s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:27 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j Apr 10 18:31:27 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:27 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:27 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Deleted volume successfully. Apr 10 18:31:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dcc22e00-d5d0-486e-8aec-62f7604b816c tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-f39407da-937a-4c62-801a-ddf6adc2d318-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:28 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:28 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f Apr 10 18:31:28 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:28 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j" returned: 1 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_4rgrii9j' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2924cf65-1a0f-4ab6-ae65-555816099b80]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:28 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD Apr 10 18:31:28 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:28 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-db368c4d-3fe1-4341-910e-110266fd347f" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-db368c4d-3fe1-4341-910e-110266fd347f" released by "delete_volume" :: held 0.978s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Created reservations ['2810ffe8-6e00-4b54-b6f4-413418a7f3a6', '67d8eb50-f963-4449-9e89-363497ee9b08', '7dd9a278-8f4c-40f7-8ed5-dd14a1b18763', '17cd2787-ebcc-49cd-8a55-a81c028ce724'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:28 devstack sudo[88782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:28 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:28 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] efad70a4-2f7f-4812-890b-f0ef460d14cf was qcow2, converting to raw {{(pid=82020) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:28 devstack sudo[88787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:28 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:28 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.415s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Deleted volume successfully. Apr 10 18:31:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6b5f8ecd-b7f9-4e4b-97bc-0b421d09b9db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-db368c4d-3fe1-4341-910e-110266fd347f-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:29 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 0 in 0.822s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_61pd0lzvdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:31:29 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:29 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 1G Apr 10 18:31:29 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-7da44e30-5345-4de1-8ea5-f651f2178e2d-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-7da44e30-5345-4de1-8ea5-f651f2178e2d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-quobyte-7da44e30-5345-4de1-8ea5-f651f2178e2d" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-7da44e30-5345-4de1-8ea5-f651f2178e2d" acquired by "delete_volume" :: waited 0.022s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0422b2bd-1417-4e92-9ca8-0758f01703d2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:29 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d Apr 10 18:31:29 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:29 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 1G" returned: 0 in 0.489s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8e2bd-3a1a-4db6-9cbe-d027f419270a]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:30 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:30 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:30 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:30 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d Apr 10 18:31:30 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:30 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 0 in 0.488s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:30 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7da44e30-5345-4de1-8ea5-f651f2178e2d" returned: 0 in 0.404s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-7da44e30-5345-4de1-8ea5-f651f2178e2d" released by "delete_volume" :: held 0.910s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:30 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:30 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Created reservations ['3991f140-9414-4e12-955a-82d7aa2166ab', 'cb97390e-fec8-4252-a633-63a0383510f7', '2e193523-9cf7-4f8c-96ce-a551322a555b', 'd19ca627-9b0f-41fc-9eca-73f0e0586cf5'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:30 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:30 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-ce03067e-4dda-46f8-8647-425e68b47b28-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-ce03067e-4dda-46f8-8647-425e68b47b28-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-quobyte-ce03067e-4dda-46f8-8647-425e68b47b28" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-ce03067e-4dda-46f8-8647-425e68b47b28" acquired by "delete_volume" :: waited 0.018s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a324e-3275-43dc-870b-e50c6d04f730]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:30 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 Apr 10 18:31:30 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:31 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 1 in 0.537s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Downloaded image efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume d092f791-4ebd-410a-bbb3-fb2042c78651 successfully. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf for user c9905592317b46fcb6ff7b3f85263160 is deleted. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Marking volume d092f791-4ebd-410a-bbb3-fb2042c78651 as bootable. {{(pid=82020) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Copying metadata from image efad70a4-2f7f-4812-890b-f0ef460d14cf to d092f791-4ebd-410a-bbb3-fb2042c78651. {{(pid=82020) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Creating volume glance metadata for volume d092f791-4ebd-410a-bbb3-fb2042c78651 backed by image efad70a4-2f7f-4812-890b-f0ef460d14cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82020) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce9722c-0801-49d9-b0e5-27e7f9a2d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d092f791-4ebd-410a-bbb3-fb2042c78651', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b991b917-1177-4f77-bd9b-76c1d507f756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:31 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.466s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:31 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Volume volume-d092f791-4ebd-410a-bbb3-fb2042c78651 (d092f791-4ebd-410a-bbb3-fb2042c78651): created successfully Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b991b917-1177-4f77-bd9b-76c1d507f756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Flow 'volume_create_manager' (0af674c5-4feb-494b-bfbe-152188f3b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Deleted volume successfully. Apr 10 18:31:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a6b24282-c0b1-4786-aa03-6c4e7cb81f48 tempest-VolumesImageMetadata-1221309954 None] Created volume successfully. Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dee6da66-29a1-40f8-9874-6115bd94dd91 tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-7da44e30-5345-4de1-8ea5-f651f2178e2d-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:31 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28" returned: 0 in 0.502s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:31 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28 Apr 10 18:31:31 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:31 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ce03067e-4dda-46f8-8647-425e68b47b28" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-ce03067e-4dda-46f8-8647-425e68b47b28" released by "delete_volume" :: held 0.958s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Created reservations ['814297ab-4a2b-4115-bc33-8b3461e5674d', '3a7d946a-5fb5-4d16-8d2e-de0231c122f3', '2e5de946-1b56-4ead-8b24-afca90b4a7c5', 'bea03192-10dd-45bd-b4a9-6154a66a8d06'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:31 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:31 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-a8117d0a-9fea-4f50-a03a-068b53e86701-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-a8117d0a-9fea-4f50-a03a-068b53e86701-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "cinder-quobyte-a8117d0a-9fea-4f50-a03a-068b53e86701" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-a8117d0a-9fea-4f50-a03a-068b53e86701" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6d8391-36c8-4341-8b78-f88137348467]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:31 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 Apr 10 18:31:31 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:32 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.437s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:32 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Deleted volume successfully. Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18ce30eb-16b8-43db-b530-1bee2cfb205d tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-ce03067e-4dda-46f8-8647-425e68b47b28-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Acquiring lock "cinder-d092f791-4ebd-410a-bbb3-fb2042c78651-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Lock "cinder-d092f791-4ebd-410a-bbb3-fb2042c78651-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Acquiring lock "cinder-quobyte-d092f791-4ebd-410a-bbb3-fb2042c78651" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Lock "cinder-quobyte-d092f791-4ebd-410a-bbb3-fb2042c78651" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a74a3-b8f9-4803-9fdd-d5b9e75c8122]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:32 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701" returned: 0 in 0.526s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:32 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701 Apr 10 18:31:32 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:32 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:32 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:32 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a8117d0a-9fea-4f50-a03a-068b53e86701" returned: 0 in 0.431s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-quobyte-a8117d0a-9fea-4f50-a03a-068b53e86701" released by "delete_volume" :: held 0.979s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:32 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 0 in 0.463s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Created reservations ['7b342bfd-b419-4293-bac8-37544306569a', 'bdc2f691-75d2-45ed-bcdb-d5909af8f57f', '9c35f6c1-3899-4f22-bd74-9f2f9c50f585', '180587c9-ee11-4046-ae10-0367037b9994'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:32 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:32 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:32 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:32 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:33 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 1 in 0.455s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:33 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651 Apr 10 18:31:33 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:33 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Deleted volume successfully. Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-dc033df1-cfb6-485c-b339-21bfef7431db tempest-CreateVolumesFromImageTest-1870137779 None] Lock "cinder-a8117d0a-9fea-4f50-a03a-068b53e86701-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:33 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-d092f791-4ebd-410a-bbb3-fb2042c78651" returned: 0 in 0.414s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Lock "cinder-quobyte-d092f791-4ebd-410a-bbb3-fb2042c78651" released by "delete_volume" :: held 1.369s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Created reservations ['ad58241f-1741-41c4-a108-01c6473b4b7d', '7e82f486-21ec-4a12-823a-f2eaa4aa693c', '71c01a55-e8ea-4a89-a985-0b9b19a3f68a', '218225c2-e592-43e0-b799-d896f2212c9e'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:33 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:33 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:34 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.428s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:34 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:34 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Deleted volume successfully. Apr 10 18:31:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3ddca35c-c355-4196-b695-dbda2e3cf115 tempest-VolumesImageMetadata-1221309954 None] Lock "cinder-d092f791-4ebd-410a-bbb3-fb2042c78651-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (73304709-a898-4fc5-9978-f1ca5b21808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155a6aae-a96f-42d0-a508-b965d0c7f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155a6aae-a96f-42d0-a508-b965d0c7f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507096138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36327107-8695-47cf-9cd6-71c1b5d510d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:36Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fcee71-cea4-474a-b357-3da05197cdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fcee71-cea4-474a-b357-3da05197cdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9a6673-eb87-40de-9e3c-67165312eccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9a6673-eb87-40de-9e3c-67165312eccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36327107-8695-47cf-9cd6-71c1b5d510d5', 'volume_name': 'volume-36327107-8695-47cf-9cd6-71c1b5d510d5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaad4d6-cf92-42a2-a43a-f08cc40aabda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaad4d6-cf92-42a2-a43a-f08cc40aabda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292ecb1b-e5be-43b7-ad9a-de7c3e69c920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:35 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume 36327107-8695-47cf-9cd6-71c1b5d510d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36327107-8695-47cf-9cd6-71c1b5d510d5', 'volume_size': 1} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-507096138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36327107-8695-47cf-9cd6-71c1b5d510d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:36Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating volume 36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:35 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:35 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 1073741824 Apr 10 18:31:35 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Flow 'volume_create_manager' (08e458bc-4400-49e5-afe7-2edad651dc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1aeb1b-1e46-47f9-a5e5-f610579d1099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1aeb1b-1e46-47f9-a5e5-f610579d1099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-229882212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e891afc-d299-4f03-b244-5ff39b2292b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f60645570bc4e9ab6244a89c08480c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:36Z,use_quota=True,user_id='46eb90b3d74544e087ca4c1d63ce5cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150fbd7-cc8d-4930-8440-a6891503258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150fbd7-cc8d-4930-8440-a6891503258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce6b5f6-1636-4990-8d3f-afa077969d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce6b5f6-1636-4990-8d3f-afa077969d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e891afc-d299-4f03-b244-5ff39b2292b6', 'volume_name': 'volume-7e891afc-d299-4f03-b244-5ff39b2292b6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5205d3-3243-4a89-b3c6-f53d14f36083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5205d3-3243-4a89-b3c6-f53d14f36083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40236624-ffab-44c6-aa19-2ed03862716d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:36 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Volume 7e891afc-d299-4f03-b244-5ff39b2292b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e891afc-d299-4f03-b244-5ff39b2292b6', 'volume_size': 1} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:36 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 1073741824" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:36 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 Apr 10 18:31:36 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:36 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-229882212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e891afc-d299-4f03-b244-5ff39b2292b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f60645570bc4e9ab6244a89c08480c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:36Z,use_quota=True,user_id='46eb90b3d74544e087ca4c1d63ce5cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Creating volume 7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:36 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:36 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 1073741824 Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292ecb1b-e5be-43b7-ad9a-de7c3e69c920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36327107-8695-47cf-9cd6-71c1b5d510d5', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:36 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e68f4c-a379-4805-90fe-4eaf25f33bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:36 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume volume-36327107-8695-47cf-9cd6-71c1b5d510d5 (36327107-8695-47cf-9cd6-71c1b5d510d5): created successfully Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e68f4c-a379-4805-90fe-4eaf25f33bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:36 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (73304709-a898-4fc5-9978-f1ca5b21808f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:36 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e1ada45c-5ec2-47d8-b43e-ffe3f5f9dba9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created volume successfully. Apr 10 18:31:37 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 1073741824" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:37 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 Apr 10 18:31:37 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:37 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6" returned: 0 in 0.400s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40236624-ffab-44c6-aa19-2ed03862716d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e891afc-d299-4f03-b244-5ff39b2292b6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9646753-959d-442a-b23f-99313ef6cfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:37 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Volume volume-7e891afc-d299-4f03-b244-5ff39b2292b6 (7e891afc-d299-4f03-b244-5ff39b2292b6): created successfully Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9646753-959d-442a-b23f-99313ef6cfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Flow 'volume_create_manager' (08e458bc-4400-49e5-afe7-2edad651dc45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:37 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-891598c7-b53b-4ff2-bdd7-9831d41f3fb8 tempest-SnapshotMetadataTestJSON-810435334 None] Created volume successfully. Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating offline snapshot b866437c-94eb-4812-b1d1-6a85a3dc5555 of volume 36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe70d81-4477-42cc-8148-6daf55750d25]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:38 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 Apr 10 18:31:38 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:38 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:38 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 1G Apr 10 18:31:38 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:38 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 1G" returned: 0 in 0.456s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36327107-8695-47cf-9cd6-71c1b5d510d5 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:39 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36327107-8695-47cf-9cd6-71c1b5d510d5 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 Apr 10 18:31:39 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:39 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36327107-8695-47cf-9cd6-71c1b5d510d5 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555" returned: 0 in 0.445s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:39 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 is being set with open permissions: ugo+rw Apr 10 18:31:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:39 devstack sudo[88936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 Apr 10 18:31:39 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:39 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555" returned: 0 in 0.430s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:39 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info Apr 10 18:31:39 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:40 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info" returned: 0 in 0.426s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:40 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info is being set with open permissions: ugo+rw Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:40 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info Apr 10 18:31:40 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:40 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.info" returned: 0 in 0.407s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.241s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Creating offline snapshot b367c1eb-e4e5-4baa-b4d7-06d9235b5495 of volume 7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:31:40 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-95c12c9e-d588-402f-bf96-6077965d89d9 tempest-CreateVolumesFromSnapshotTest-254378670 None] Create snapshot completed successfully Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60e5d04-ed87-4bcb-8684-3d2a5a61ae2d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:40 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 Apr 10 18:31:40 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:41 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:41 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 1G Apr 10 18:31:41 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (47d2ad17-2ff4-41c0-8362-4a623aa6b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a8efca-cd5d-4247-94c6-ca5c357a91fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a8efca-cd5d-4247-94c6-ca5c357a91fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273734547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcf4a76-91f1-4400-bea2-93ecef022db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:41Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd7d17a-4edc-4c52-9f10-3ccbd9fe40ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd7d17a-4edc-4c52-9f10-3ccbd9fe40ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148f202a-3a52-475c-859b-39f2d3f387ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (148f202a-3a52-475c-859b-39f2d3f387ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bcf4a76-91f1-4400-bea2-93ecef022db4', 'volume_name': 'volume-5bcf4a76-91f1-4400-bea2-93ecef022db4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ece8d8-1b89-42a1-b788-5134e77fba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53ece8d8-1b89-42a1-b788-5134e77fba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed9f43e-38a8-444b-b8fe-07703a45c8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume 5bcf4a76-91f1-4400-bea2-93ecef022db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bcf4a76-91f1-4400-bea2-93ecef022db4', 'volume_size': 1} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (25b78097-68d9-4e0b-a969-079cc783f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57bcc1b-5eb5-424b-95a5-fe225783e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57bcc1b-5eb5-424b-95a5-fe225783e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486890833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001f2c20-fa77-4284-94cb-278d5edb1a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:41Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ce6701-e5c4-45f4-a5f5-56d243c8976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ce6701-e5c4-45f4-a5f5-56d243c8976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b27a82-fda0-4f4d-b57e-a180885d7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b27a82-fda0-4f4d-b57e-a180885d7597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001f2c20-fa77-4284-94cb-278d5edb1a8d', 'volume_name': 'volume-001f2c20-fa77-4284-94cb-278d5edb1a8d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cbc3a5-3f9a-4bf6-8e90-8be83bb67f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cbc3a5-3f9a-4bf6-8e90-8be83bb67f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0736c2-d977-4420-996f-b03df50f59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume 001f2c20-fa77-4284-94cb-278d5edb1a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001f2c20-fa77-4284-94cb-278d5edb1a8d', 'volume_size': 1} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (fe907b27-203f-4d50-a5ef-57951811ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc2d366-ac59-4342-8723-09f095795d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc2d366-ac59-4342-8723-09f095795d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229294150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df47d621-ef7a-4c9a-9ae4-00cc9b666fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:42Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06937d54-5232-4dc3-a744-df6996b3fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06937d54-5232-4dc3-a744-df6996b3fc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6ef55f-c258-4c23-ac43-967e7f848cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6ef55f-c258-4c23-ac43-967e7f848cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df47d621-ef7a-4c9a-9ae4-00cc9b666fe0', 'volume_name': 'volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef53ca7a-01a8-4337-81ee-a9927e92fc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef53ca7a-01a8-4337-81ee-a9927e92fc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2914fe4a-de6c-4ebd-8a35-6fc57df37bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume df47d621-ef7a-4c9a-9ae4-00cc9b666fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0', 'volume_size': 1} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:41 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 1G" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e891afc-d299-4f03-b244-5ff39b2292b6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:41 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e891afc-d299-4f03-b244-5ff39b2292b6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 Apr 10 18:31:41 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (dbdae0eb-0410-407f-98d3-e45e5fde9e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1908a09-c457-4384-845c-dba2483c379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1908a09-c457-4384-845c-dba2483c379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1427919441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487ae28f-16d8-489b-bf95-7c33e44d41e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:42Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d35844-65a8-4e0a-b2aa-707601c0d6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d35844-65a8-4e0a-b2aa-707601c0d6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71d0bd8-64a6-4c41-9b24-d4fd70d1a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71d0bd8-64a6-4c41-9b24-d4fd70d1a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487ae28f-16d8-489b-bf95-7c33e44d41e0', 'volume_name': 'volume-487ae28f-16d8-489b-bf95-7c33e44d41e0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e3a694-7a3e-4b50-a2fe-6f353c20e4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e3a694-7a3e-4b50-a2fe-6f353c20e4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb28afe3-9024-48f2-8b6c-76541d7cdd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:41 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume 487ae28f-16d8-489b-bf95-7c33e44d41e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487ae28f-16d8-489b-bf95-7c33e44d41e0', 'volume_size': 1} Apr 10 18:31:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (37e8366f-5571-447a-903a-1f09a01c8dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47a8847-0175-4803-b209-a05cc7d2cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47a8847-0175-4803-b209-a05cc7d2cb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160405889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8230418a-6ec7-477e-a44d-59662764e4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:42Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffb6dcc-ddbe-411f-9753-4516eb2ecfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffb6dcc-ddbe-411f-9753-4516eb2ecfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4cfa72-0624-4d13-a4ee-9beec052297d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4cfa72-0624-4d13-a4ee-9beec052297d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8230418a-6ec7-477e-a44d-59662764e4b0', 'volume_name': 'volume-8230418a-6ec7-477e-a44d-59662764e4b0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88db0b81-d59a-4cd9-aa4a-c6f331abe629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88db0b81-d59a-4cd9-aa4a-c6f331abe629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0a83e1-e33c-4459-87a2-433838b0e08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:42 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume 8230418a-6ec7-477e-a44d-59662764e4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8230418a-6ec7-477e-a44d-59662764e4b0', 'volume_size': 1} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:42 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e891afc-d299-4f03-b244-5ff39b2292b6 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495" returned: 0 in 0.452s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:42 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 is being set with open permissions: ugo+rw Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:42 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 Apr 10 18:31:42 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:42 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495" returned: 0 in 0.424s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:42 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info Apr 10 18:31:42 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:43 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:43 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info is being set with open permissions: ugo+rw Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:43 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info Apr 10 18:31:43 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:43 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.info" returned: 0 in 0.407s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-273734547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bcf4a76-91f1-4400-bea2-93ecef022db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:41Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating volume 5bcf4a76-91f1-4400-bea2-93ecef022db4 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:43 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:43 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 1073741824 Apr 10 18:31:43 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:43 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e4814f88-4f0d-4250-bbe1-ef86098690da tempest-SnapshotMetadataTestJSON-810435334 None] Create snapshot completed successfully Apr 10 18:31:44 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 1073741824" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:44 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 Apr 10 18:31:44 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:44 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4" returned: 0 in 0.435s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486890833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001f2c20-fa77-4284-94cb-278d5edb1a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:41Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating volume 001f2c20-fa77-4284-94cb-278d5edb1a8d {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:44 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed9f43e-38a8-444b-b8fe-07703a45c8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bcf4a76-91f1-4400-bea2-93ecef022db4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:44 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d 1073741824 Apr 10 18:31:44 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e29230-d6a4-47d2-9321-4c1284c885eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:44 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 (5bcf4a76-91f1-4400-bea2-93ecef022db4): created successfully Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e29230-d6a4-47d2-9321-4c1284c885eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (47d2ad17-2ff4-41c0-8362-4a623aa6b59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:44 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e0189a4f-0288-4da9-8042-2ccd6f927a04 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created volume successfully. Apr 10 18:31:45 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d 1073741824" returned: 0 in 0.594s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "cinder-b367c1eb-e4e5-4baa-b4d7-06d9235b5495-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-b367c1eb-e4e5-4baa-b4d7-06d9235b5495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "cinder-quobyte-7e891afc-d299-4f03-b244-5ff39b2292b6" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:45 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d Apr 10 18:31:45 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-quobyte-7e891afc-d299-4f03-b244-5ff39b2292b6" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "cinder-quobyte-b367c1eb-e4e5-4baa-b4d7-06d9235b5495" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-quobyte-b367c1eb-e4e5-4baa-b4d7-06d9235b5495" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Deleting offline snapshot b367c1eb-e4e5-4baa-b4d7-06d9235b5495 of volume 7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] snapshot_file for this snap is: volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f018725-ad3f-45c2-85b8-22edeba30de2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:45 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 Apr 10 18:31:45 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:45 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.802s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-229294150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df47d621-ef7a-4c9a-9ae4-00cc9b666fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:42Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating volume df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:45 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:45 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 1073741824 Apr 10 18:31:45 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0736c2-d977-4420-996f-b03df50f59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001f2c20-fa77-4284-94cb-278d5edb1a8d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90b9c34-ea72-4401-9d63-229fac57fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:45 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume volume-001f2c20-fa77-4284-94cb-278d5edb1a8d (001f2c20-fa77-4284-94cb-278d5edb1a8d): created successfully Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90b9c34-ea72-4401-9d63-229fac57fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (25b78097-68d9-4e0b-a969-079cc783f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e3504c70-f7b5-444c-947c-da5c279d4069 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created volume successfully. Apr 10 18:31:45 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495" returned: 0 in 0.523s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e891afc-d299-4f03-b244-5ff39b2292b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[360d82f3-c4cf-4bd8-b6e9-bbff195f13fa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:45 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 Apr 10 18:31:45 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:46 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 1073741824" returned: 0 in 0.478s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:46 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 Apr 10 18:31:46 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:46 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6" returned: 0 in 0.490s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:46 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 Apr 10 18:31:46 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:46 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0" returned: 0 in 0.459s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.525s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1427919441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487ae28f-16d8-489b-bf95-7c33e44d41e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:42Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating volume 487ae28f-16d8-489b-bf95-7c33e44d41e0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:46 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2914fe4a-de6c-4ebd-8a35-6fc57df37bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc27c08d-51af-420d-8eb9-07dfcd55c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:46 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 1073741824 Apr 10 18:31:46 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:46 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 (df47d621-ef7a-4c9a-9ae4-00cc9b666fe0): created successfully Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc27c08d-51af-420d-8eb9-07dfcd55c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (fe907b27-203f-4d50-a5ef-57951811ae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:46 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f469bb67-b47d-4e50-b9e3-264a50ddc7ee tempest-CreateVolumesFromSnapshotTest-254378670 None] Created volume successfully. Apr 10 18:31:46 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:46 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495 Apr 10 18:31:46 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:47 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 1073741824" returned: 0 in 0.498s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:47 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 Apr 10 18:31:47 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:47 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6.b367c1eb-e4e5-4baa-b4d7-06d9235b5495" returned: 0 in 0.437s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-quobyte-b367c1eb-e4e5-4baa-b4d7-06d9235b5495" released by "_delete_snapshot" :: held 1.952s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-quobyte-7e891afc-d299-4f03-b244-5ff39b2292b6" released by "delete_snapshot" :: held 1.964s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Created reservations ['555fccd3-b888-4cd6-a0fa-f497dd9dd4ee', '73167c0b-a27d-458d-ab77-d4e78d3a6591', '6d368ff1-3dde-4933-ade0-262b5badf7a1', '67c9f431-6211-45db-9c90-e45c1c94143f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:47 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Delete snapshot completed successfully. Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fb491fb4-826c-456e-81fb-3010bff2c4f3 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-b367c1eb-e4e5-4baa-b4d7-06d9235b5495-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "cinder-7e891afc-d299-4f03-b244-5ff39b2292b6-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-7e891afc-d299-4f03-b244-5ff39b2292b6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "cinder-quobyte-7e891afc-d299-4f03-b244-5ff39b2292b6" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-quobyte-7e891afc-d299-4f03-b244-5ff39b2292b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f69357-23d8-4313-a980-fb2a0f0ad659]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:47 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 Apr 10 18:31:47 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:47 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.353s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160405889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8230418a-6ec7-477e-a44d-59662764e4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7261bdcf2ab74127be107bedcb218827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:42Z,use_quota=True,user_id='667df6acf3de4d3e9e5a3debbc6ad81e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Creating volume 8230418a-6ec7-477e-a44d-59662764e4b0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:47 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb28afe3-9024-48f2-8b6c-76541d7cdd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487ae28f-16d8-489b-bf95-7c33e44d41e0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:47 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 1073741824 Apr 10 18:31:47 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c2dcc1-2d8d-4cf8-8683-d2a4578f8899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 (487ae28f-16d8-489b-bf95-7c33e44d41e0): created successfully Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c2dcc1-2d8d-4cf8-8683-d2a4578f8899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (dbdae0eb-0410-407f-98d3-e45e5fde9e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:47 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0a1915cd-b81b-4186-a40a-648eb1e00444 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created volume successfully. Apr 10 18:31:47 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6" returned: 0 in 0.500s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:47 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6 Apr 10 18:31:47 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:48 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 1073741824" returned: 0 in 0.489s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:48 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 Apr 10 18:31:48 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:48 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7e891afc-d299-4f03-b244-5ff39b2292b6" returned: 0 in 0.447s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-quobyte-7e891afc-d299-4f03-b244-5ff39b2292b6" released by "delete_volume" :: held 0.984s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Created reservations ['0fa80ec8-3682-4d8f-bf32-768ab6305f4b', '7d370dd3-62d1-4ff1-abb2-921c0b8c6038', 'b467ab62-484a-42a2-b779-f59f788aa7ff', '40ed32bf-eca5-4bd6-bab8-366fdc1f7d0d'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:48 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:48 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:48 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0a83e1-e33c-4459-87a2-433838b0e08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8230418a-6ec7-477e-a44d-59662764e4b0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5fc482-4dbc-4c9b-b64f-5901a63bbc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:48 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Volume volume-8230418a-6ec7-477e-a44d-59662764e4b0 (8230418a-6ec7-477e-a44d-59662764e4b0): created successfully Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5fc482-4dbc-4c9b-b64f-5901a63bbc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Flow 'volume_create_manager' (37e8366f-5571-447a-903a-1f09a01c8dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-17d68619-f432-4b80-8a16-fed2bbf03a7f tempest-CreateVolumesFromSnapshotTest-254378670 None] Created volume successfully. Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-8230418a-6ec7-477e-a44d-59662764e4b0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-8230418a-6ec7-477e-a44d-59662764e4b0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-8230418a-6ec7-477e-a44d-59662764e4b0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-8230418a-6ec7-477e-a44d-59662764e4b0" acquired by "delete_volume" :: waited 0.019s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[80192110-f799-4eea-8aa7-fd7aa8691102]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:48 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Deleted volume successfully. Apr 10 18:31:48 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 Apr 10 18:31:48 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fad64b84-7298-44f2-823e-c05764991ba0 tempest-SnapshotMetadataTestJSON-810435334 None] Lock "cinder-7e891afc-d299-4f03-b244-5ff39b2292b6-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:49 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0" returned: 0 in 0.603s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:49 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0 Apr 10 18:31:49 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:49 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8230418a-6ec7-477e-a44d-59662764e4b0" returned: 0 in 0.458s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-8230418a-6ec7-477e-a44d-59662764e4b0" released by "delete_volume" :: held 1.086s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=231,cinder:INSERT=79,cinder:UPDATE=306,cinder:DELETE=21 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=198,cinder:UPDATE=290,cinder:DELETE=31,cinder:INSERT=78 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['14f87f81-6002-4b7b-bce1-c7a558fe3d94', 'aa6ec5d8-8ad1-40ad-b388-958df38da207', 'd7827c79-eda6-4f61-9b9d-277ba5aeba70', 'd33a0d00-bcad-484f-9999-96e9ca98332e'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:49 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:49 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:50 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.415s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleted volume successfully. Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f732f850-4a09-4af9-9a8f-d039fed90595 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-8230418a-6ec7-477e-a44d-59662764e4b0-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Flow 'volume_create_manager' (9a2fd724-ca5f-48db-97c2-8287aca05474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a03f25c-c824-48a1-93f1-2aebe7f525f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a03f25c-c824-48a1-93f1-2aebe7f525f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-50267487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9a46fe-cefd-411d-9992-ffe20661f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b15195cac0430eabec88eb74322f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:51Z,use_quota=True,user_id='8d9c93348b5741d0a8285216340628bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb56968-9d94-4bff-bf56-ca4cca1389b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdb56968-9d94-4bff-bf56-ca4cca1389b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6400750-94ba-41fe-be54-1f014b267137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6400750-94ba-41fe-be54-1f014b267137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b9a46fe-cefd-411d-9992-ffe20661f0af', 'volume_name': 'volume-8b9a46fe-cefd-411d-9992-ffe20661f0af', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f93ac2-10da-4c2e-80e1-8222a27fe0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f93ac2-10da-4c2e-80e1-8222a27fe0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626a3013-d537-485d-a1ec-6399670b1e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:50 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Volume 8b9a46fe-cefd-411d-9992-ffe20661f0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b9a46fe-cefd-411d-9992-ffe20661f0af', 'volume_size': 1} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-50267487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b9a46fe-cefd-411d-9992-ffe20661f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b15195cac0430eabec88eb74322f9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:51Z,use_quota=True,user_id='8d9c93348b5741d0a8285216340628bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Creating volume 8b9a46fe-cefd-411d-9992-ffe20661f0af {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:50 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:50 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af 1073741824 Apr 10 18:31:50 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-487ae28f-16d8-489b-bf95-7c33e44d41e0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-487ae28f-16d8-489b-bf95-7c33e44d41e0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-487ae28f-16d8-489b-bf95-7c33e44d41e0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-487ae28f-16d8-489b-bf95-7c33e44d41e0" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48b6de4-c6a3-41c8-baa8-f780164811d0]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:50 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 Apr 10 18:31:50 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:51 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af 1073741824" returned: 0 in 0.497s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:51 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af Apr 10 18:31:51 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:51 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0" returned: 0 in 0.517s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:51 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0 Apr 10 18:31:51 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:51 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af" returned: 0 in 0.404s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626a3013-d537-485d-a1ec-6399670b1e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b9a46fe-cefd-411d-9992-ffe20661f0af', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b96cca4-bfb8-4daf-ba70-7fa3173c0aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:51 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Volume volume-8b9a46fe-cefd-411d-9992-ffe20661f0af (8b9a46fe-cefd-411d-9992-ffe20661f0af): created successfully Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b96cca4-bfb8-4daf-ba70-7fa3173c0aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Flow 'volume_create_manager' (9a2fd724-ca5f-48db-97c2-8287aca05474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:51 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-674563fb-fe01-417e-bdd5-d132beb19566 tempest-AbsoluteLimitsTests-1008903661 None] Created volume successfully. Apr 10 18:31:51 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-487ae28f-16d8-489b-bf95-7c33e44d41e0" returned: 0 in 0.427s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-487ae28f-16d8-489b-bf95-7c33e44d41e0" released by "delete_volume" :: held 0.966s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['d58b940f-758f-48cb-8e9a-4e9f63331cdf', '62b68988-b837-4265-9b2e-076eca3f9d06', '3960a15b-8efc-4b92-a513-168f40fd3638', '67ae5a37-9701-4140-869e-32c0e4181dc0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:51 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:51 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:51 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[09620f02-db31-45d4-971b-88e6d4af3f88]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:52 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 Apr 10 18:31:52 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:52 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.425s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleted volume successfully. Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4064f394-8a3f-437c-9d52-609cba2f0be7 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-487ae28f-16d8-489b-bf95-7c33e44d41e0-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:52 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:52 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0 Apr 10 18:31:52 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Acquiring lock "cinder-8b9a46fe-cefd-411d-9992-ffe20661f0af-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Lock "cinder-8b9a46fe-cefd-411d-9992-ffe20661f0af-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Acquiring lock "cinder-quobyte-8b9a46fe-cefd-411d-9992-ffe20661f0af" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Lock "cinder-quobyte-8b9a46fe-cefd-411d-9992-ffe20661f0af" acquired by "delete_volume" :: waited 0.016s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a9e60-dca7-4064-a6a8-f4c795f97536]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:52 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af Apr 10 18:31:52 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:52 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0" returned: 0 in 0.441s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0" released by "delete_volume" :: held 0.922s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['0b57edc7-ee4e-47a7-80a2-462ef7b11195', '616b72e1-1a4e-41bf-be92-96f5ad11d9ec', '77b1ccf0-4f33-4f67-9b56-99e4f03dce0e', '286a81eb-b5a9-43a8-94d0-8fd57e51e6cc'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:53 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:53 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-001f2c20-fa77-4284-94cb-278d5edb1a8d-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-001f2c20-fa77-4284-94cb-278d5edb1a8d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-001f2c20-fa77-4284-94cb-278d5edb1a8d" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-001f2c20-fa77-4284-94cb-278d5edb1a8d" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724ff5e-d588-4d80-8bf2-24da1dc8bc3f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:53 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d Apr 10 18:31:53 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:53 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af" returned: 0 in 0.482s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:53 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af Apr 10 18:31:53 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:53 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.443s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:53 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleted volume successfully. Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bd3aeeff-c443-421c-9398-25088c5de8f8 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-df47d621-ef7a-4c9a-9ae4-00cc9b666fe0-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:53 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:53 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d Apr 10 18:31:53 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:53 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-8b9a46fe-cefd-411d-9992-ffe20661f0af" returned: 0 in 0.406s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Lock "cinder-quobyte-8b9a46fe-cefd-411d-9992-ffe20661f0af" released by "delete_volume" :: held 0.910s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Created reservations ['40d0d4a9-04b6-4aee-87ef-41f2dfa0b47e', 'b21a8066-f986-46cb-8e5f-a75449f9af4b', '88de7034-e4ff-4621-a93f-d9086c2a6057', '84ebafd6-73da-4fc4-ae55-d3d2ed5d3bfb'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:53 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:53 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:54 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-001f2c20-fa77-4284-94cb-278d5edb1a8d" returned: 0 in 0.426s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-001f2c20-fa77-4284-94cb-278d5edb1a8d" released by "delete_volume" :: held 0.919s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['d6e342e3-57e1-4253-b1c5-41edd2659be6', '34712fe5-fbe3-4657-9efc-fcf6fb07d4ef', 'c06d735b-0ac8-4e65-9228-384074f8dac6', '2cea9fff-1a03-40a7-a7f4-fb5b0ec17fdf'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:54 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:54 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-5bcf4a76-91f1-4400-bea2-93ecef022db4-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-5bcf4a76-91f1-4400-bea2-93ecef022db4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:54 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-5bcf4a76-91f1-4400-bea2-93ecef022db4" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.443s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Deleted volume successfully. Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-5bcf4a76-91f1-4400-bea2-93ecef022db4" acquired by "delete_volume" :: waited 0.016s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bc197461-d9a6-4008-ac25-9afb28828980 tempest-AbsoluteLimitsTests-1008903661 None] Lock "cinder-8b9a46fe-cefd-411d-9992-ffe20661f0af-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[def75394-8ab0-4e5e-a4e0-0795c833a8ff]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:54 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 Apr 10 18:31:54 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:54 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.521s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleted volume successfully. Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1874e72c-882d-4e7c-9158-fad1d8fca41e tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-001f2c20-fa77-4284-94cb-278d5edb1a8d-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:54 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4" returned: 0 in 0.568s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:54 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4 Apr 10 18:31:54 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:55 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5bcf4a76-91f1-4400-bea2-93ecef022db4" returned: 0 in 0.498s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-5bcf4a76-91f1-4400-bea2-93ecef022db4" released by "delete_volume" :: held 1.090s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['add10d2d-0321-4fb5-9ff2-e6c3788b9242', '0d55861d-e022-4d96-8696-cd1f5e268cf5', 'c0a37f70-94e8-41e8-b901-21c532fa71a0', 'b8902e4c-86ee-4420-a992-0b6e8165ccce'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:55 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:55 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:55 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.455s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:55 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleted volume successfully. Apr 10 18:31:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-41518fc4-b230-46fd-a73d-9029c5e0f0e4 tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-5bcf4a76-91f1-4400-bea2-93ecef022db4-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-b866437c-94eb-4812-b1d1-6a85a3dc5555-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-b866437c-94eb-4812-b1d1-6a85a3dc5555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-36327107-8695-47cf-9cd6-71c1b5d510d5" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-36327107-8695-47cf-9cd6-71c1b5d510d5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-b866437c-94eb-4812-b1d1-6a85a3dc5555" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-b866437c-94eb-4812-b1d1-6a85a3dc5555" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleting offline snapshot b866437c-94eb-4812-b1d1-6a85a3dc5555 of volume 36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] snapshot_file for this snap is: volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3f1de0-4bc4-4a9e-9a81-eec31a114b67]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:56 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 Apr 10 18:31:56 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:56 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555" returned: 0 in 0.547s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:56 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36327107-8695-47cf-9cd6-71c1b5d510d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[db515ef2-d36e-4eb6-8297-a1a3c3ebc9c4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:57 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 Apr 10 18:31:57 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Flow 'volume_create_manager' (f3a0627b-3fcc-4d02-8713-db1db4f6fceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898fcdf3-704e-4998-8d66-1617deee41ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898fcdf3-704e-4998-8d66-1617deee41ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1793242918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f03903f-3ebb-421b-9895-1c923508d945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9d546cd55a4c0786f9e32c638ceb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:57Z,use_quota=True,user_id='8fa2dd09ab3f4c11a73f5e17078058d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb7e60a-02de-41ed-8cd2-821d5196d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb7e60a-02de-41ed-8cd2-821d5196d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657b8310-ecb6-435d-b21d-6376f3197f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (657b8310-ecb6-435d-b21d-6376f3197f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f03903f-3ebb-421b-9895-1c923508d945', 'volume_name': 'volume-3f03903f-3ebb-421b-9895-1c923508d945', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a363a626-0ab9-4807-81a3-ae47ee189a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a363a626-0ab9-4807-81a3-ae47ee189a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea63f6d-228a-4e82-9be8-1ee243baddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:57 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Volume 3f03903f-3ebb-421b-9895-1c923508d945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f03903f-3ebb-421b-9895-1c923508d945', 'volume_size': 1} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1793242918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f03903f-3ebb-421b-9895-1c923508d945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9d546cd55a4c0786f9e32c638ceb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:31:57Z,use_quota=True,user_id='8fa2dd09ab3f4c11a73f5e17078058d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Creating volume 3f03903f-3ebb-421b-9895-1c923508d945 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:31:57 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:57 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 1073741824 Apr 10 18:31:57 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:57 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:57 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 Apr 10 18:31:57 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:57 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 1073741824" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:57 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 Apr 10 18:31:57 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:57 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:57 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555 Apr 10 18:31:57 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:58 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945" returned: 0 in 0.431s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea63f6d-228a-4e82-9be8-1ee243baddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f03903f-3ebb-421b-9895-1c923508d945', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786da0df-6e75-41e8-8b50-b645010cf685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:31:58 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Volume volume-3f03903f-3ebb-421b-9895-1c923508d945 (3f03903f-3ebb-421b-9895-1c923508d945): created successfully Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786da0df-6e75-41e8-8b50-b645010cf685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Flow 'volume_create_manager' (f3a0627b-3fcc-4d02-8713-db1db4f6fceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:31:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5d740b98-58d9-47f5-ab09-02932d1ccc27 tempest-VolumesTransfersV357Test-317957820 None] Created volume successfully. Apr 10 18:31:58 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5.b866437c-94eb-4812-b1d1-6a85a3dc5555" returned: 0 in 0.425s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-b866437c-94eb-4812-b1d1-6a85a3dc5555" released by "_delete_snapshot" :: held 1.965s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-36327107-8695-47cf-9cd6-71c1b5d510d5" released by "delete_snapshot" :: held 1.976s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['5efa9d4f-f878-4c80-ad00-fc376f4fbce2', 'c311ef54-f082-4e7a-b31e-d84029e64c5c', 'ebcea384-8384-44c2-9dc0-c06f72343213', '41ed82d0-c672-4214-a7de-4d10a97ba2e7'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Delete snapshot completed successfully. Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-af34d135-93d2-443d-b737-ddf209e63a4d tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-b866437c-94eb-4812-b1d1-6a85a3dc5555-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-36327107-8695-47cf-9cd6-71c1b5d510d5-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-36327107-8695-47cf-9cd6-71c1b5d510d5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "cinder-quobyte-36327107-8695-47cf-9cd6-71c1b5d510d5" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-36327107-8695-47cf-9cd6-71c1b5d510d5" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d383357-a761-485a-b54c-05359e0609df]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:31:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:58 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 Apr 10 18:31:58 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:59 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5" returned: 0 in 0.454s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:59 devstack sudo[89147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5 Apr 10 18:31:59 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:59 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36327107-8695-47cf-9cd6-71c1b5d510d5" returned: 0 in 0.414s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-quobyte-36327107-8695-47cf-9cd6-71c1b5d510d5" released by "delete_volume" :: held 0.900s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Created reservations ['979e2d11-e3c7-447a-9c81-89a67fbd201e', 'bdaa308f-b9ad-4865-aedc-aca0e08eaa8e', '723ee3fd-02d1-4710-ac6f-c0252326719f', '14eb1967-79f7-4f7a-8ab3-03508c1476ae'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:31:59 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:31:59 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:31:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-69b5e9f9-059b-460c-850c-1795aaafedfe tempest-VolumesTransfersV357Test-1213653476 None] Transfer volume completed successfully. Apr 10 18:31:59 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.429s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:31:59 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Deleted volume successfully. Apr 10 18:31:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-46421406-e7af-4ac2-905b-124dc3ffb9ed tempest-CreateVolumesFromSnapshotTest-254378670 None] Lock "cinder-36327107-8695-47cf-9cd6-71c1b5d510d5-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Acquiring lock "cinder-3f03903f-3ebb-421b-9895-1c923508d945-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-3f03903f-3ebb-421b-9895-1c923508d945-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Acquiring lock "cinder-quobyte-3f03903f-3ebb-421b-9895-1c923508d945" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-quobyte-3f03903f-3ebb-421b-9895-1c923508d945" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:00 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3121b8-f59f-4fc2-8e62-b4a7ff38866e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:00 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 Apr 10 18:32:00 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:01 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:01 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945 Apr 10 18:32:01 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Flow 'volume_create_manager' (fb711b85-6d0d-4dfc-9f56-bab0b8ba4b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c400077-2ce5-4762-8942-180431f8a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c400077-2ce5-4762-8942-180431f8a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdaec95-580f-4bba-92fa-6178d0b83bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f3703e81b4f608c87c1e456490c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:01Z,use_quota=True,user_id='389806696a8746559adaf46524afdc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1752dbb-0d8c-4168-b4a9-39749b3ca849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1752dbb-0d8c-4168-b4a9-39749b3ca849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f07958-97cb-44c9-aa31-0a26733c812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f07958-97cb-44c9-aa31-0a26733c812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfdaec95-580f-4bba-92fa-6178d0b83bc6', 'volume_name': 'volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa230fb-0d05-41fd-bba1-8d27bd4cdb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa230fb-0d05-41fd-bba1-8d27bd4cdb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b12247d-7b2f-4f39-8af9-76089201b70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Volume bfdaec95-580f-4bba-92fa-6178d0b83bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6', 'volume_size': 1} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdaec95-580f-4bba-92fa-6178d0b83bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f3703e81b4f608c87c1e456490c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:01Z,use_quota=True,user_id='389806696a8746559adaf46524afdc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Creating volume bfdaec95-580f-4bba-92fa-6178d0b83bc6 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:01 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:01 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 1073741824 Apr 10 18:32:01 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:01 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3f03903f-3ebb-421b-9895-1c923508d945" returned: 0 in 0.437s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-quobyte-3f03903f-3ebb-421b-9895-1c923508d945" released by "delete_volume" :: held 0.962s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Created reservations ['7d9a80a2-f632-4f75-a88c-92929923b365', '576a28e5-ee64-4a19-ae39-842c407481a5', '46603bb2-edde-4b88-ac85-1f2a353d08ef', 'dd814722-28b1-4ef1-9525-9ff141c9ba82'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:01 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:01 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 1073741824" returned: 0 in 0.532s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:01 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:01 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 Apr 10 18:32:01 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Flow 'volume_create_manager' (5cc24e40-f410-4be0-924b-d6b5af8e9c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bf541d-4989-411c-9fca-5f546a25be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bf541d-4989-411c-9fca-5f546a25be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-372622465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec2ae45-dcc3-44da-99dd-1fdf1d502d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9d546cd55a4c0786f9e32c638ceb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:02Z,use_quota=True,user_id='8fa2dd09ab3f4c11a73f5e17078058d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5081a7bc-cefb-4e75-bd74-cd4e34819b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5081a7bc-cefb-4e75-bd74-cd4e34819b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5739360a-3b22-44c1-aad8-c558efd1aee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5739360a-3b22-44c1-aad8-c558efd1aee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aec2ae45-dcc3-44da-99dd-1fdf1d502d23', 'volume_name': 'volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22257a5-376f-4f5b-ae5c-42d58c2dd8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22257a5-376f-4f5b-ae5c-42d58c2dd8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5c8255-4cff-4845-ac25-c68f9372c7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Volume aec2ae45-dcc3-44da-99dd-1fdf1d502d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23', 'volume_size': 1} Apr 10 18:32:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:02 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.495s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Deleted volume successfully. Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-78abfc85-e2ee-4d74-8dc2-a669f55c1ab1 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-3f03903f-3ebb-421b-9895-1c923508d945-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:02 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6" returned: 0 in 0.430s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-372622465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aec2ae45-dcc3-44da-99dd-1fdf1d502d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9d546cd55a4c0786f9e32c638ceb53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:02Z,use_quota=True,user_id='8fa2dd09ab3f4c11a73f5e17078058d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Creating volume aec2ae45-dcc3-44da-99dd-1fdf1d502d23 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:02 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b12247d-7b2f-4f39-8af9-76089201b70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddcd452-6c21-4159-994e-e6eb7e286932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:02 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 1073741824 Apr 10 18:32:02 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Volume volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 (bfdaec95-580f-4bba-92fa-6178d0b83bc6): created successfully Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ddcd452-6c21-4159-994e-e6eb7e286932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Flow 'volume_create_manager' (fb711b85-6d0d-4dfc-9f56-bab0b8ba4b64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b5bac94d-3ba3-4184-a9ef-841711185659 tempest-CinderUnicodeTest-402202830 None] Created volume successfully. Apr 10 18:32:02 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 1073741824" returned: 0 in 0.492s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:02 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 Apr 10 18:32:02 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:03 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23" returned: 0 in 0.402s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5c8255-4cff-4845-ac25-c68f9372c7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63ddb50-24f5-4081-b05d-6e9df60b22ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Volume volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 (aec2ae45-dcc3-44da-99dd-1fdf1d502d23): created successfully Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63ddb50-24f5-4081-b05d-6e9df60b22ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Flow 'volume_create_manager' (5cc24e40-f410-4be0-924b-d6b5af8e9c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-549afefa-7e2a-42ca-9fb6-50eb96c2265f tempest-VolumesTransfersV357Test-317957820 None] Created volume successfully. Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Flow 'volume_create_manager' (78725b2f-9f7a-47ae-ba21-944422c4d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70784f3-69b8-4088-9411-bd3b3d347cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70784f3-69b8-4088-9411-bd3b3d347cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-569959398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1068f68d-4d59-4897-b0f4-332615b39eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f3703e81b4f608c87c1e456490c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:04Z,use_quota=True,user_id='389806696a8746559adaf46524afdc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832d4dd3-518d-428a-8bc7-05a580c403d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832d4dd3-518d-428a-8bc7-05a580c403d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d881d3ae-ca22-4187-9bb5-130002e97209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d881d3ae-ca22-4187-9bb5-130002e97209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1068f68d-4d59-4897-b0f4-332615b39eb0', 'volume_name': 'volume-1068f68d-4d59-4897-b0f4-332615b39eb0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63bcd02-3af7-49fb-bbfe-71aec513f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63bcd02-3af7-49fb-bbfe-71aec513f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379a1000-ec09-442f-bfa5-5c2ad83900bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Volume 1068f68d-4d59-4897-b0f4-332615b39eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1068f68d-4d59-4897-b0f4-332615b39eb0', 'volume_size': 1} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-569959398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1068f68d-4d59-4897-b0f4-332615b39eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94f3703e81b4f608c87c1e456490c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:04Z,use_quota=True,user_id='389806696a8746559adaf46524afdc90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Creating volume 1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:03 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:03 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 1073741824 Apr 10 18:32:03 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:04 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 1073741824" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Acquiring lock "cinder-aec2ae45-dcc3-44da-99dd-1fdf1d502d23-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-aec2ae45-dcc3-44da-99dd-1fdf1d502d23-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:04 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 Apr 10 18:32:04 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Acquiring lock "cinder-quobyte-aec2ae45-dcc3-44da-99dd-1fdf1d502d23" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-quobyte-aec2ae45-dcc3-44da-99dd-1fdf1d502d23" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5539217e-ab77-40e9-b77c-c7dfaaf76687]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:04 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 Apr 10 18:32:04 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:04 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0" returned: 0 in 0.410s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379a1000-ec09-442f-bfa5-5c2ad83900bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1068f68d-4d59-4897-b0f4-332615b39eb0', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c392fa15-2aa6-456d-b434-5908a15f6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Volume volume-1068f68d-4d59-4897-b0f4-332615b39eb0 (1068f68d-4d59-4897-b0f4-332615b39eb0): created successfully Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c392fa15-2aa6-456d-b434-5908a15f6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Flow 'volume_create_manager' (78725b2f-9f7a-47ae-ba21-944422c4d696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8b80fe13-f791-4bc4-91d6-8e50bda1b3c8 tempest-CinderUnicodeTest-402202830 None] Created volume successfully. Apr 10 18:32:04 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23" returned: 0 in 0.466s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:04 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23 Apr 10 18:32:04 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:05 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-aec2ae45-dcc3-44da-99dd-1fdf1d502d23" returned: 0 in 0.408s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-quobyte-aec2ae45-dcc3-44da-99dd-1fdf1d502d23" released by "delete_volume" :: held 0.894s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Created reservations ['96b01ba1-bfeb-4f7a-b8d5-3592360d00ae', '9dfad82e-58bb-4c16-a0a2-f6741749f3f8', '5dbe6743-6345-4b8e-a667-51483cef4568', '27ee6ae6-1056-40ce-8831-cba06618e785'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:05 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:05 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:05 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.458s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:05 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Deleted volume successfully. Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c318f182-72e7-4ed0-a3db-3deaf2478370 tempest-VolumesTransfersV357Test-219622170 None] Lock "cinder-aec2ae45-dcc3-44da-99dd-1fdf1d502d23-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Creating offline snapshot 2184a664-e7e7-4552-ac9c-8f719b796726 of volume 1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[34af9d86-6e79-4316-85ca-2789d3e09c5d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:05 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 Apr 10 18:32:05 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:06 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0" returned: 0 in 0.512s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:06 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 1G Apr 10 18:32:06 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:06 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 1G" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1068f68d-4d59-4897-b0f4-332615b39eb0 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:06 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1068f68d-4d59-4897-b0f4-332615b39eb0 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 Apr 10 18:32:06 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:07 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1068f68d-4d59-4897-b0f4-332615b39eb0 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726" returned: 0 in 0.447s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:07 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 is being set with open permissions: ugo+rw Apr 10 18:32:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:07 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 Apr 10 18:32:07 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:07 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726" returned: 0 in 0.430s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:07 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info Apr 10 18:32:07 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:08 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info" returned: 0 in 0.456s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:08 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info is being set with open permissions: ugo+rw Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:08 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info Apr 10 18:32:08 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Flow 'volume_create_manager' (8d851368-1702-4f24-b8fb-d4fd52f444f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6874261d-ef16-4d0c-b76f-a7a7fcda94ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6874261d-ef16-4d0c-b76f-a7a7fcda94ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1957562224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b07e7b-6354-46a5-9306-a0cd10401f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d369510df473a8c90382d74c8610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:08Z,use_quota=True,user_id='e909c9d1d552482b93b6869b5d1b50ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8f7d5-3f6a-4d32-b54d-8da8ce0aa2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f8f7d5-3f6a-4d32-b54d-8da8ce0aa2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f638d3-4b18-4afd-8754-6ae7dd6b35b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f638d3-4b18-4afd-8754-6ae7dd6b35b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26b07e7b-6354-46a5-9306-a0cd10401f03', 'volume_name': 'volume-26b07e7b-6354-46a5-9306-a0cd10401f03', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea85d26-fd61-4155-965a-dd9da60b5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea85d26-fd61-4155-965a-dd9da60b5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1872ee-36ab-4214-b77f-8d1f70ac9923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:08 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Volume 26b07e7b-6354-46a5-9306-a0cd10401f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26b07e7b-6354-46a5-9306-a0cd10401f03', 'volume_size': 1} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:08 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.info" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.859s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.223s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1957562224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26b07e7b-6354-46a5-9306-a0cd10401f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d369510df473a8c90382d74c8610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:08Z,use_quota=True,user_id='e909c9d1d552482b93b6869b5d1b50ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Creating volume 26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:08 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:08 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 1073741824 Apr 10 18:32:08 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-27743102-cb57-493e-b802-c26e4796643e tempest-CinderUnicodeTest-402202830 None] Create snapshot completed successfully Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-2184a664-e7e7-4552-ac9c-8f719b796726-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Lock "cinder-2184a664-e7e7-4552-ac9c-8f719b796726-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-quobyte-1068f68d-4d59-4897-b0f4-332615b39eb0" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-1068f68d-4d59-4897-b0f4-332615b39eb0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-quobyte-2184a664-e7e7-4552-ac9c-8f719b796726" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-2184a664-e7e7-4552-ac9c-8f719b796726" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Deleting offline snapshot 2184a664-e7e7-4552-ac9c-8f719b796726 of volume 1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] snapshot_file for this snap is: volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[87afaaf9-553c-41f5-9c84-6528140f0d46]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:09 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 Apr 10 18:32:09 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:09 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 1073741824" returned: 0 in 0.514s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:09 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:09 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:09 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726" returned: 0 in 0.506s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1068f68d-4d59-4897-b0f4-332615b39eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc420af5-2baf-461c-b96a-3362ab99b30a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:09 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 Apr 10 18:32:09 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:09 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.425s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1872ee-36ab-4214-b77f-8d1f70ac9923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26b07e7b-6354-46a5-9306-a0cd10401f03', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c265283-a725-4974-9911-227fcc6ebdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:09 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Volume volume-26b07e7b-6354-46a5-9306-a0cd10401f03 (26b07e7b-6354-46a5-9306-a0cd10401f03): created successfully Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c265283-a725-4974-9911-227fcc6ebdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:09 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Flow 'volume_create_manager' (8d851368-1702-4f24-b8fb-d4fd52f444f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:09 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-75ccbac1-586b-49d9-a06f-1a2c9f86f17a tempest-VolumesCloneTest-768593210 None] Created volume successfully. Apr 10 18:32:10 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:10 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 Apr 10 18:32:10 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:10 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726" returned: 0 in 0.466s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:10 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726 Apr 10 18:32:10 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Flow 'volume_create_manager' (c2fd14ef-f228-4658-aa6b-7b63252fa4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66828e8-512e-4280-830a-addb4f7849de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66828e8-512e-4280-830a-addb4f7849de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1836806414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbfde38-2e5e-4b42-adab-cacc2b1249c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88d369510df473a8c90382d74c8610e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=26b07e7b-6354-46a5-9306-a0cd10401f03,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:11Z,use_quota=True,user_id='e909c9d1d552482b93b6869b5d1b50ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e43b4c7-4f1e-44be-9084-db28ce35de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e43b4c7-4f1e-44be-9084-db28ce35de60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4debbe6-f8e8-4ce2-90a4-2e62f1a9b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4debbe6-f8e8-4ce2-90a4-2e62f1a9b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3dbfde38-2e5e-4b42-adab-cacc2b1249c2', 'volume_name': 'volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2', 'volume_size': 2, 'source_volid': '26b07e7b-6354-46a5-9306-a0cd10401f03', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2773ac5a-6db4-41b2-9a48-7fa528b6b1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2773ac5a-6db4-41b2-9a48-7fa528b6b1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff78901-7a67-491f-86eb-91f0da2e6364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:10 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Volume 3dbfde38-2e5e-4b42-adab-cacc2b1249c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2', 'volume_size': 2, 'source_volid': '26b07e7b-6354-46a5-9306-a0cd10401f03', 'source_volstatus': 'available'} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:10 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Cloning volume 26b07e7b-6354-46a5-9306-a0cd10401f03 to volume 3dbfde38-2e5e-4b42-adab-cacc2b1249c2 Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Creating offline snapshot e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 of volume 26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[32af06eb-d3a5-4442-a160-e3aca30e3a71]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:10 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:10 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:10 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0.2184a664-e7e7-4552-ac9c-8f719b796726" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:10 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-2184a664-e7e7-4552-ac9c-8f719b796726" released by "_delete_snapshot" :: held 1.973s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-1068f68d-4d59-4897-b0f4-332615b39eb0" released by "delete_snapshot" :: held 1.989s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Created reservations ['aca7af70-f495-42f4-934b-46ac3c7b8f9e', 'be548856-757f-4877-9be1-c997fd93cdca', '58f25baa-afea-4507-bbf4-9c56849bd316', 'fdf2d0f2-4329-454d-a882-d9e04d8683c8'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:11 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Delete snapshot completed successfully. Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f84f3ea3-39e6-4e13-b9ea-cba77fa092ab tempest-CinderUnicodeTest-402202830 None] Lock "cinder-2184a664-e7e7-4552-ac9c-8f719b796726-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-1068f68d-4d59-4897-b0f4-332615b39eb0-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Lock "cinder-1068f68d-4d59-4897-b0f4-332615b39eb0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-quobyte-1068f68d-4d59-4897-b0f4-332615b39eb0" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-1068f68d-4d59-4897-b0f4-332615b39eb0" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d310b27-3c28-4baa-bfab-030b761fcd52]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:11 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 Apr 10 18:32:11 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:11 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:11 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 1G Apr 10 18:32:11 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:11 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0" returned: 0 in 0.477s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:11 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0 Apr 10 18:32:11 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:11 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 1G" returned: 0 in 0.499s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b07e7b-6354-46a5-9306-a0cd10401f03 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:11 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b07e7b-6354-46a5-9306-a0cd10401f03 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 Apr 10 18:32:11 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:12 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1068f68d-4d59-4897-b0f4-332615b39eb0" returned: 0 in 0.416s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-1068f68d-4d59-4897-b0f4-332615b39eb0" released by "delete_volume" :: held 0.931s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Created reservations ['dae74ac1-6099-46e3-bc44-4afe4e00e946', '385763e3-933a-4e98-82b4-80ce1d4803c7', '989d53ad-bafb-4f4d-8384-e3b3f17d4886', '7ba3a35e-3ef6-4cf4-9157-c4f394e11bd4'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:12 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:12 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-bfdaec95-580f-4bba-92fa-6178d0b83bc6-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Lock "cinder-bfdaec95-580f-4bba-92fa-6178d0b83bc6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Acquiring lock "cinder-quobyte-bfdaec95-580f-4bba-92fa-6178d0b83bc6" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-bfdaec95-580f-4bba-92fa-6178d0b83bc6" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7493516-8caa-4127-8f13-878c1ef508be]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:12 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26b07e7b-6354-46a5-9306-a0cd10401f03 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" returned: 0 in 0.442s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:12 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 is being set with open permissions: ugo+rw Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:12 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 Apr 10 18:32:12 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:12 devstack sudo[89277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 Apr 10 18:32:12 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:12 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.442s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Deleted volume successfully. Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8c42b953-cddb-4efa-b02d-1f94e81c3278 tempest-CinderUnicodeTest-402202830 None] Lock "cinder-1068f68d-4d59-4897-b0f4-332615b39eb0-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:12 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" returned: 0 in 0.421s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:12 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6" returned: 0 in 0.464s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:12 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info Apr 10 18:32:12 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:12 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6 Apr 10 18:32:12 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:13 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info" returned: 0 in 0.411s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:13 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:13 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info is being set with open permissions: ugo+rw Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bfdaec95-580f-4bba-92fa-6178d0b83bc6" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Lock "cinder-quobyte-bfdaec95-580f-4bba-92fa-6178d0b83bc6" released by "delete_volume" :: held 0.905s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:13 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info Apr 10 18:32:13 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Created reservations ['7023c03b-6d1d-4b91-ac93-a9f2bbf6bffe', '783ab78c-f546-4fbd-8399-54fe13084cea', '20335fa5-90ba-4fd9-8a25-12e28fde8ff9', '5dac0637-ab83-4a30-bc23-4d65aa6d8c71'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:13 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:13 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:13 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.info" returned: 0 in 0.435s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Acquiring lock "cinder-quobyte-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] snapshot: e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9, volume: 3dbfde38-2e5e-4b42-adab-cacc2b1249c2, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8482abc2-d6e4-4dcc-be6b-ce88a9f9a150]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:13 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 Apr 10 18:32:13 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:13 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.501s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:13 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Deleted volume successfully. Apr 10 18:32:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-7e570979-a4e2-497b-8d97-18b6ab9f8b7e tempest-CinderUnicodeTest-402202830 None] Lock "cinder-bfdaec95-580f-4bba-92fa-6178d0b83bc6-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:14 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" returned: 0 in 0.531s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26b07e7b-6354-46a5-9306-a0cd10401f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b2b68a-544f-4202-9bd5-b28e7f979b44]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:14 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:14 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:14 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:32:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:14 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 Apr 10 18:32:14 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:16 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" returned: 0 in 1.922s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e9d29-befb-463b-8e9a-d3ef4b9704d6]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:16 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:16 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:16 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:16 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:17 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.405s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:17 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.612s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:32:17 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Converted 1024.00 MB image at 532.44 MB/s Apr 10 18:32:17 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 is being set with open permissions: ugo+rw Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:17 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 Apr 10 18:32:17 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:17 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" returned: 0 in 0.405s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" released by "_copy_volume_from_snapshot" :: held 3.983s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Acquiring lock "cinder-quobyte-e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Deleting offline snapshot e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 of volume 26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] snapshot_file for this snap is: volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4140ba-8c85-49f8-93d6-6850c0e16d45]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:17 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 Apr 10 18:32:17 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:18 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26b07e7b-6354-46a5-9306-a0cd10401f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:32:18 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d72e5-5e28-4e04-8767-5b6eed022cc8]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:18 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:18 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:18 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:18 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 Apr 10 18:32:18 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:19 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:19 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9 Apr 10 18:32:19 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:19 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03.e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" returned: 0 in 0.404s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-e6a0b1ed-a98a-4426-93ba-fac5d2ef5ce9" released by "_delete_snapshot" :: held 1.810s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.606s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff78901-7a67-491f-86eb-91f0da2e6364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2', 'volume_size': 2, 'source_volid': '26b07e7b-6354-46a5-9306-a0cd10401f03', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fe36e8-05d5-4840-b0b9-fd3f05c1094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:19 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Volume volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 (3dbfde38-2e5e-4b42-adab-cacc2b1249c2): created successfully Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fe36e8-05d5-4840-b0b9-fd3f05c1094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Flow 'volume_create_manager' (c2fd14ef-f228-4658-aa6b-7b63252fa4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3de91abc-1c20-4e70-b7ad-e74dc822774b tempest-VolumesCloneTest-768593210 None] Created volume successfully. Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Acquiring lock "cinder-3dbfde38-2e5e-4b42-adab-cacc2b1249c2-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Lock "cinder-3dbfde38-2e5e-4b42-adab-cacc2b1249c2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Acquiring lock "cinder-quobyte-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1341e30-5b56-4c13-bc47-cd3c5e12b9fa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:20 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 Apr 10 18:32:20 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:20 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" returned: 0 in 0.477s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:20 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2 Apr 10 18:32:20 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:21 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" returned: 0 in 0.394s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-3dbfde38-2e5e-4b42-adab-cacc2b1249c2" released by "delete_volume" :: held 0.895s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Created reservations ['6f05c902-ab19-4594-bf9d-3da5f82c0c02', '9e52587d-9328-4369-90c1-a2fc14d75f56', '6240ff8d-f553-4d43-8668-63486b3d924a', '6061aa0f-0329-4ddd-a3e4-67223bdcc068'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:21 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:21 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Acquiring lock "cinder-26b07e7b-6354-46a5-9306-a0cd10401f03-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Lock "cinder-26b07e7b-6354-46a5-9306-a0cd10401f03-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Acquiring lock "cinder-quobyte-26b07e7b-6354-46a5-9306-a0cd10401f03" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-26b07e7b-6354-46a5-9306-a0cd10401f03" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d72c5b4-6c61-46bc-903b-6fd8c98f227e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:21 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:21 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:21 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.415s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Deleted volume successfully. Apr 10 18:32:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-818a168e-1783-4694-91d3-003dfa1187cb tempest-VolumesCloneTest-768593210 None] Lock "cinder-3dbfde38-2e5e-4b42-adab-cacc2b1249c2-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:22 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.463s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:22 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03 Apr 10 18:32:22 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:22 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-26b07e7b-6354-46a5-9306-a0cd10401f03" returned: 0 in 0.395s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Lock "cinder-quobyte-26b07e7b-6354-46a5-9306-a0cd10401f03" released by "delete_volume" :: held 0.892s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Created reservations ['b99a9fcb-4047-4b92-9374-cb69a2a5a2bc', 'e94e6e9c-ff4d-49ac-8f24-31e3b4de1300', '7dd97f4c-40c4-4bc9-b1f9-8d58e31ffa6b', 'eb48f4ca-804a-4321-aa11-ea1d162435fb'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:22 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:22 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:23 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:23 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Deleted volume successfully. Apr 10 18:32:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e0a2c735-0673-4e6e-b2e9-04807787ff19 tempest-VolumesCloneTest-768593210 None] Lock "cinder-26b07e7b-6354-46a5-9306-a0cd10401f03-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Flow 'volume_create_manager' (d493a341-2b1f-4fca-a095-a512264e9bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a9a9e3-8118-4936-876a-2b773d9448d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1a9a9e3-8118-4936-876a-2b773d9448d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1908576096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037a44f6-dfe2-4649-b545-58da63ddb9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff25f68e6641c79801c745ce8ba0a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:24Z,use_quota=True,user_id='375efaecf3d94678a22975bf90845461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e50da1d-91e0-4f3b-a31b-eb71f7bfc625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e50da1d-91e0-4f3b-a31b-eb71f7bfc625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69ad426-6d44-4c75-b0b3-6bdd9b2d445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.image.glance [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Creating Keystone auth plugin from conf {{(pid=82020) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69ad426-6d44-4c75-b0b3-6bdd9b2d445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '037a44f6-dfe2-4649-b545-58da63ddb9e6', 'volume_name': 'volume-037a44f6-dfe2-4649-b545-58da63ddb9e6', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3035ec-4d14-4cad-a975-25deb0a8e1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3035ec-4d14-4cad-a975-25deb0a8e1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e594d3-0103-4752-9bca-3b3dbf932f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Volume 037a44f6-dfe2-4649-b545-58da63ddb9e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-037a44f6-dfe2-4649-b545-58da63ddb9e6', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Trying to clone 037a44f6-dfe2-4649-b545-58da63ddb9e6 from image efad70a4-2f7f-4812-890b-f0ef460d14cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]). {{(pid=82020) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 18:32:24 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Image download 20.69 MB at 20.69 MB/s Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1316f4d-9190-4276-b4d2-0f238429c7e4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:25 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD Apr 10 18:32:25 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:25 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf is fetched for user 375efaecf3d94678a22975bf90845461. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e723d7-5f4a-4e58-8830-e44ae6303f2d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:25 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD Apr 10 18:32:25 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:25 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1908576096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=037a44f6-dfe2-4649-b545-58da63ddb9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff25f68e6641c79801c745ce8ba0a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:24Z,use_quota=True,user_id='375efaecf3d94678a22975bf90845461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Creating volume 037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:25 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:25 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 1073741824 Apr 10 18:32:25 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:26 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 1073741824" returned: 0 in 0.477s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:26 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:26 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:26 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 0 in 0.416s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Attempting download of efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume 037a44f6-dfe2-4649-b545-58da63ddb9e6. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c88fdc-eda6-4170-ae9c-58454f02c32d]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:26 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd Apr 10 18:32:26 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:27 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd" returned: 0 in 0.451s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:27 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd Apr 10 18:32:27 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:27 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd" returned: 1 in 0.452s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_efad70a4-2f7f-4812-890b-f0ef460d14cf_m7z_5bzd' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:32:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac88e1-9542-4557-ae47-bec9ca23ffa3]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:27 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD Apr 10 18:32:27 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:28 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:28 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] efad70a4-2f7f-4812-890b-f0ef460d14cf was qcow2, converting to raw {{(pid=82020) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 18:32:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:28 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:28 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:29 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 0 in 0.820s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_efad70a4-2f7f-4812-890b-f0ef460d14cf_am5kubnidevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:32:29 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:29 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 1G Apr 10 18:32:29 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:29 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 1G" returned: 0 in 0.426s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5af0f11-116b-4d70-899e-038f4d34d5db]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:29 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:29 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:29 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:30 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:30 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:30 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 1 in 0.453s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Downloaded image efad70a4-2f7f-4812-890b-f0ef460d14cf ((None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}])) to volume 037a44f6-dfe2-4649-b545-58da63ddb9e6 successfully. {{(pid=82020) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Temporary image efad70a4-2f7f-4812-890b-f0ef460d14cf for user 375efaecf3d94678a22975bf90845461 is deleted. {{(pid=82020) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.volume_utils [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Marking volume 037a44f6-dfe2-4649-b545-58da63ddb9e6 as bootable. {{(pid=82020) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Copying metadata from image efad70a4-2f7f-4812-890b-f0ef460d14cf to 037a44f6-dfe2-4649-b545-58da63ddb9e6. {{(pid=82020) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Creating volume glance metadata for volume 037a44f6-dfe2-4649-b545-58da63ddb9e6 backed by image efad70a4-2f7f-4812-890b-f0ef460d14cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82020) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e594d3-0103-4752-9bca-3b3dbf932f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-037a44f6-dfe2-4649-b545-58da63ddb9e6', 'volume_size': 1, 'image_id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/efad70a4-2f7f-4812-890b-f0ef460d14cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8399b34f9bd146a185fd2345d2d19a25', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'efad70a4-2f7f-4812-890b-f0ef460d14cf', 'created_at': datetime.datetime(2026, 4, 10, 16, 20, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 16, 20, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/efad70a4-2f7f-4812-890b-f0ef460d14cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9baaef5a-6756-473a-a24c-e229940a6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:30 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Volume volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 (037a44f6-dfe2-4649-b545-58da63ddb9e6): created successfully Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9baaef5a-6756-473a-a24c-e229940a6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Flow 'volume_create_manager' (d493a341-2b1f-4fca-a095-a512264e9bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-25cfa121-60af-40f7-bec6-6444b3126fcd tempest-VolumesExtendTest-324292325 None] Created volume successfully. Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97eb181-bdcc-497a-900b-7603434fd682]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:30 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:30 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:31 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:31 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:31 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:31 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 1 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 2G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 2G" returned: 0 in 0.036s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.986s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-64378983-7a1f-4724-bbb0-85b2256f152a tempest-VolumesExtendTest-324292325 None] Extend volume completed successfully. Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-037a44f6-dfe2-4649-b545-58da63ddb9e6-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Lock "cinder-037a44f6-dfe2-4649-b545-58da63ddb9e6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-quobyte-037a44f6-dfe2-4649-b545-58da63ddb9e6" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-037a44f6-dfe2-4649-b545-58da63ddb9e6" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[909d4b2d-b687-4521-ada2-609cde8c24a8]: (4, 'raw') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:32 devstack sudo[89455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:32 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:32 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 0 in 0.453s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:32 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:32 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:33 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 1 in 0.455s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6' failed. Not Retrying. {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:33 devstack sudo[89464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6 Apr 10 18:32:33 devstack sudo[89464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:33 devstack sudo[89464]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-037a44f6-dfe2-4649-b545-58da63ddb9e6" returned: 0 in 0.410s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-037a44f6-dfe2-4649-b545-58da63ddb9e6" released by "delete_volume" :: held 1.360s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Created reservations ['24ebec3d-617d-4d5c-ac5b-b7edc442b973', '991b9ed9-e779-49d4-91ac-aa9b90087f54', '6f17d488-d90d-4632-905c-7047fbbb7147', '2031273f-d92e-44e9-970d-5808e7f0594d'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:33 devstack sudo[89467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:33 devstack sudo[89467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:33 devstack sudo[89467]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.399s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Deleted volume successfully. Apr 10 18:32:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6230faf3-0d77-4668-bc9a-805072aaba58 tempest-VolumesExtendTest-324292325 None] Lock "cinder-037a44f6-dfe2-4649-b545-58da63ddb9e6-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Flow 'volume_create_manager' (3239a2b7-9a61-4232-88f0-24b9e1ee8496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaff632-cfcf-4d19-b186-b040bcd27e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaff632-cfcf-4d19-b186-b040bcd27e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-87820479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e23b9f8-d1da-4078-a529-93694bd160bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff25f68e6641c79801c745ce8ba0a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:34Z,use_quota=True,user_id='375efaecf3d94678a22975bf90845461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1288cf-8dc2-482e-bfae-65723d205fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1288cf-8dc2-482e-bfae-65723d205fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b3dab6-46b1-4be9-acee-37e5bc1e0599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b3dab6-46b1-4be9-acee-37e5bc1e0599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e23b9f8-d1da-4078-a529-93694bd160bc', 'volume_name': 'volume-2e23b9f8-d1da-4078-a529-93694bd160bc', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc2d78-aabf-4462-9fa9-4a01483783d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc2d78-aabf-4462-9fa9-4a01483783d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6080a9-d625-4f28-8468-f770bd21b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:34 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Volume 2e23b9f8-d1da-4078-a529-93694bd160bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e23b9f8-d1da-4078-a529-93694bd160bc', 'volume_size': 1} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-87820479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e23b9f8-d1da-4078-a529-93694bd160bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff25f68e6641c79801c745ce8ba0a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:34Z,use_quota=True,user_id='375efaecf3d94678a22975bf90845461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Creating volume 2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:34 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:34 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc 1073741824 Apr 10 18:32:34 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:34 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc 1073741824" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:34 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc Apr 10 18:32:34 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:35 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc" returned: 0 in 0.404s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6080a9-d625-4f28-8468-f770bd21b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e23b9f8-d1da-4078-a529-93694bd160bc', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4b0168-b22e-4cad-9ea7-125f6fee427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:35 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Volume volume-2e23b9f8-d1da-4078-a529-93694bd160bc (2e23b9f8-d1da-4078-a529-93694bd160bc): created successfully Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4b0168-b22e-4cad-9ea7-125f6fee427a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Flow 'volume_create_manager' (3239a2b7-9a61-4232-88f0-24b9e1ee8496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-50cb984e-cdff-4e0b-8f89-210f330a8a6d tempest-VolumesExtendTest-324292325 None] Created volume successfully. Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Creating offline snapshot 2a70fad5-b600-4a5a-a402-6705f5ebdc56 of volume 2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4a28b-816f-4146-8165-bedf4bd53365]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:35 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc Apr 10 18:32:35 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:36 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc" returned: 0 in 0.456s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:36 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 1G Apr 10 18:32:36 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:36 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 1G" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e23b9f8-d1da-4078-a529-93694bd160bc -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:36 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e23b9f8-d1da-4078-a529-93694bd160bc -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 Apr 10 18:32:36 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:36 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e23b9f8-d1da-4078-a529-93694bd160bc -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56" returned: 0 in 0.429s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:36 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 is being set with open permissions: ugo+rw Apr 10 18:32:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:37 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 Apr 10 18:32:37 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:37 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:37 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info Apr 10 18:32:37 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:37 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info" returned: 0 in 0.412s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:37 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info is being set with open permissions: ugo+rw Apr 10 18:32:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:37 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info Apr 10 18:32:37 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:38 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.info" returned: 0 in 0.400s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.634s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:38 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-957e719a-8137-46d2-94fb-1f2df757858b tempest-VolumesExtendTest-324292325 None] Create snapshot completed successfully Apr 10 18:32:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:38 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8de67d-f296-4dd3-b4e3-0202076da4e2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:38 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc Apr 10 18:32:38 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:39 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc" returned: 0 in 0.456s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 2G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 2G" returned: 0 in 0.058s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.530s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:39 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ec31e9ef-5724-4382-a641-d9afc5ca8898 tempest-VolumesExtendTest-324292325 None] Extend volume completed successfully. Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-2a70fad5-b600-4a5a-a402-6705f5ebdc56-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-2a70fad5-b600-4a5a-a402-6705f5ebdc56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-quobyte-2e23b9f8-d1da-4078-a529-93694bd160bc" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-2e23b9f8-d1da-4078-a529-93694bd160bc" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-quobyte-2a70fad5-b600-4a5a-a402-6705f5ebdc56" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-2a70fad5-b600-4a5a-a402-6705f5ebdc56" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Deleting offline snapshot 2a70fad5-b600-4a5a-a402-6705f5ebdc56 of volume 2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] snapshot_file for this snap is: volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f92c1-67f5-4b4d-ae53-da88ed6850fa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:40 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 Apr 10 18:32:40 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:40 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56" returned: 0 in 0.469s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:40 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e23b9f8-d1da-4078-a529-93694bd160bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:32:40 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3771f-fd3f-48a4-ad9e-f9b4c95389d3]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:40 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc Apr 10 18:32:40 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:40 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc" returned: 0 in 0.473s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:40 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 Apr 10 18:32:40 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:41 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56" returned: 0 in 0.463s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:41 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56 Apr 10 18:32:41 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:41 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc.2a70fad5-b600-4a5a-a402-6705f5ebdc56" returned: 0 in 0.403s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-2a70fad5-b600-4a5a-a402-6705f5ebdc56" released by "_delete_snapshot" :: held 1.862s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-2e23b9f8-d1da-4078-a529-93694bd160bc" released by "delete_snapshot" :: held 1.872s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Created reservations ['7ac20333-0737-4982-ba2f-064424159f6c', 'c7290318-25bf-45c1-aa4b-3ccac4fa7858', '0ae7dac3-5512-4d0e-a57c-2888a5525d1a', '7c23b052-9f36-4bd5-872a-1b0846f9b484'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:41 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Delete snapshot completed successfully. Apr 10 18:32:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-70dc6a37-e0ca-4231-85eb-258f9f2527d9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-2a70fad5-b600-4a5a-a402-6705f5ebdc56-delete_snapshot" released by "delete_snapshot" :: held 1.948s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-2e23b9f8-d1da-4078-a529-93694bd160bc-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-2e23b9f8-d1da-4078-a529-93694bd160bc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Acquiring lock "cinder-quobyte-2e23b9f8-d1da-4078-a529-93694bd160bc" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-2e23b9f8-d1da-4078-a529-93694bd160bc" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e98b4a-5b57-454f-adb1-c88a7f611cb4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:42 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc Apr 10 18:32:42 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:42 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc" returned: 0 in 0.456s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:42 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc Apr 10 18:32:42 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:42 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2e23b9f8-d1da-4078-a529-93694bd160bc" returned: 0 in 0.397s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-quobyte-2e23b9f8-d1da-4078-a529-93694bd160bc" released by "delete_volume" :: held 0.891s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Created reservations ['ce16bb55-d5b0-4d83-8657-c9dbe4481cde', 'cc06acf9-e3db-47af-aa93-6b0f6cd8c21d', '707b3520-f3d9-47c1-b48b-11d07835b117', '84a5ca8e-9c74-48f8-96b4-210e129e4081'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:43 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:32:43 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:43 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.440s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:32:43 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Deleted volume successfully. Apr 10 18:32:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1fc02a45-8815-4255-8814-55a7882a4fe9 tempest-VolumesExtendTest-324292325 None] Lock "cinder-2e23b9f8-d1da-4078-a529-93694bd160bc-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Flow 'volume_create_manager' (10683aad-875b-4ba4-a168-7b00d6c8e58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809bd52-9b08-44ba-b756-8e9ad6274f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4809bd52-9b08-44ba-b756-8e9ad6274f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-645417100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36396208-1ba2-4f80-b950-d51cd6730edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c61aa8cea834d5eb4036fe616c8b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:45Z,use_quota=True,user_id='6cf8fe0703cc4cac8c222ec7ad45e52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ef0726-0ead-4cb1-a3fd-1dce0abcd7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ef0726-0ead-4cb1-a3fd-1dce0abcd7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13f10a4-fd5d-4a86-9d5e-cdcd59f9694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13f10a4-fd5d-4a86-9d5e-cdcd59f9694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36396208-1ba2-4f80-b950-d51cd6730edc', 'volume_name': 'volume-36396208-1ba2-4f80-b950-d51cd6730edc', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d754332-05fd-43e8-876d-4e28b849c3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d754332-05fd-43e8-876d-4e28b849c3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211e6d21-150b-43b4-84c8-2fc02fca6a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:44 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Volume 36396208-1ba2-4f80-b950-d51cd6730edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36396208-1ba2-4f80-b950-d51cd6730edc', 'volume_size': 1} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-645417100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36396208-1ba2-4f80-b950-d51cd6730edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c61aa8cea834d5eb4036fe616c8b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:32:45Z,use_quota=True,user_id='6cf8fe0703cc4cac8c222ec7ad45e52b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Creating volume 36396208-1ba2-4f80-b950-d51cd6730edc {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:32:44 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:32:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:44 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc 1073741824 Apr 10 18:32:44 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:45 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc 1073741824" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:32:45 devstack sudo[89579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc Apr 10 18:32:45 devstack sudo[89579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:32:45 devstack sudo[89579]: pam_unix(sudo:session): session closed for user root Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211e6d21-150b-43b4-84c8-2fc02fca6a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36396208-1ba2-4f80-b950-d51cd6730edc', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17e5ad4-8eb8-4319-a937-c9425bc3e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:32:45 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Volume volume-36396208-1ba2-4f80-b950-d51cd6730edc (36396208-1ba2-4f80-b950-d51cd6730edc): created successfully Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17e5ad4-8eb8-4319-a937-c9425bc3e3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:32:45 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Flow 'volume_create_manager' (10683aad-875b-4ba4-a168-7b00d6c8e58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:32:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-981bd804-4c80-4868-bfa0-13ef4e618044 tempest-VolumesNegativeTest-1448446143 None] Created volume successfully. Apr 10 18:32:55 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=123,cinder:INSERT=44,cinder:UPDATE=182,cinder:DELETE=13 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:32:55 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:INSERT=55,cinder:UPDATE=173,cinder:SELECT=139,cinder:DELETE=14 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Acquiring lock "cinder-36396208-1ba2-4f80-b950-d51cd6730edc-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Lock "cinder-36396208-1ba2-4f80-b950-d51cd6730edc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Acquiring lock "cinder-quobyte-36396208-1ba2-4f80-b950-d51cd6730edc" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Lock "cinder-quobyte-36396208-1ba2-4f80-b950-d51cd6730edc" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd937e-538c-4641-9065-8c6fc1a16a27]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:11 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc Apr 10 18:33:11 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:11 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc" returned: 0 in 0.465s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:11 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc Apr 10 18:33:11 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:12 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-36396208-1ba2-4f80-b950-d51cd6730edc" returned: 0 in 0.404s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Lock "cinder-quobyte-36396208-1ba2-4f80-b950-d51cd6730edc" released by "delete_volume" :: held 0.896s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Created reservations ['540fc46c-bd06-495e-9dde-25791255b484', '6fc603da-66a1-4d38-88a3-b967b6c6f9af', 'a199f304-3591-4784-a75f-ec7a6ee85d9a', 'a7cac023-9869-4b78-b1d8-53ce57065bd9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:12 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:12 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:12 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Deleted volume successfully. Apr 10 18:33:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6ba1c5ed-fa15-41b1-9d3e-253c67bf9a67 tempest-VolumesNegativeTest-1448446143 None] Lock "cinder-36396208-1ba2-4f80-b950-d51cd6730edc-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (2a2fcd83-1da7-4a60-a0f6-11290a45f0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a0446f-8221-4c5f-91f3-b3399b2bb858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a0446f-8221-4c5f-91f3-b3399b2bb858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1877740715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a08ac9-5f5c-4baf-9e0f-0c876c13899d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20594125aba84a0fab3218cb6d0ceba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:14Z,use_quota=True,user_id='95402df510634b63b4cf2f35b9416b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4be664-5f40-4120-9485-2f213e07bfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4be664-5f40-4120-9485-2f213e07bfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cf54a-5339-4de5-a6d6-c7d9d79a9096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3cf54a-5339-4de5-a6d6-c7d9d79a9096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a08ac9-5f5c-4baf-9e0f-0c876c13899d', 'volume_name': 'volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1edf458-863e-4750-914d-04d331bd5983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1edf458-863e-4750-914d-04d331bd5983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdb1860-190c-4476-a2d9-e69a4c1511a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:13 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Volume f4a08ac9-5f5c-4baf-9e0f-0c876c13899d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d', 'volume_size': 1} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1877740715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a08ac9-5f5c-4baf-9e0f-0c876c13899d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20594125aba84a0fab3218cb6d0ceba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:14Z,use_quota=True,user_id='95402df510634b63b4cf2f35b9416b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Creating volume f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:13 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:13 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d 1073741824 Apr 10 18:33:13 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:14 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d 1073741824" returned: 0 in 0.461s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:14 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:14 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:14 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.395s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cdb1860-190c-4476-a2d9-e69a4c1511a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cdf80e-c94d-4c77-a6c1-c7be1b929423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Volume volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d (f4a08ac9-5f5c-4baf-9e0f-0c876c13899d): created successfully Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cdf80e-c94d-4c77-a6c1-c7be1b929423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (2a2fcd83-1da7-4a60-a0f6-11290a45f0c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:14 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bc30ebb1-7a86-4351-be3d-b5278d4fff0b tempest-VolumeDependencyTests-930020233 None] Created volume successfully. Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Creating offline snapshot 3804c4eb-779f-481b-a738-4baccaeb5044 of volume f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[376d6251-5e99-46de-a417-61f7fc97a958]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:14 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:14 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:15 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:15 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 1G Apr 10 18:33:15 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:15 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 1G" returned: 0 in 0.458s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:15 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 Apr 10 18:33:15 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:16 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044" returned: 0 in 0.421s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:16 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 is being set with open permissions: ugo+rw Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:16 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 Apr 10 18:33:16 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:16 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044" returned: 0 in 0.401s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:16 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info Apr 10 18:33:16 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:16 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:16 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:16 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info" returned: 0 in 0.413s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:16 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info is being set with open permissions: ugo+rw Apr 10 18:33:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:16 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info Apr 10 18:33:16 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:17 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.405s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:17 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.info" returned: 0 in 0.415s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:17 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2e7a62e9-e657-4bde-b998-1e96c3c8c476 tempest-VolumeDependencyTests-930020233 None] Create snapshot completed successfully Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (5f4ecbf5-1a48-4357-a5ca-bea8b9598d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f06c310-a1f2-4223-893e-ce58ab482dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f06c310-a1f2-4223-893e-ce58ab482dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1346367016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0a940e-6f32-43dd-9cee-47070479ade8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20594125aba84a0fab3218cb6d0ceba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3804c4eb-779f-481b-a738-4baccaeb5044,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:18Z,use_quota=True,user_id='95402df510634b63b4cf2f35b9416b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fed58f-38e2-42b8-934a-1aa289d4db10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8fed58f-38e2-42b8-934a-1aa289d4db10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf1d212-f312-496e-a12f-e13fbc8c13ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf1d212-f312-496e-a12f-e13fbc8c13ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee0a940e-6f32-43dd-9cee-47070479ade8', 'volume_name': 'volume-ee0a940e-6f32-43dd-9cee-47070479ade8', 'volume_size': 1, 'snapshot_id': '3804c4eb-779f-481b-a738-4baccaeb5044'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf68231-a74b-43a9-9315-2be49b88bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf68231-a74b-43a9-9315-2be49b88bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f14f6ec-f3c8-47c3-aa52-2d2d5b78560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:18 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Volume ee0a940e-6f32-43dd-9cee-47070479ade8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee0a940e-6f32-43dd-9cee-47070479ade8', 'volume_size': 1, 'snapshot_id': '3804c4eb-779f-481b-a738-4baccaeb5044'} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-3804c4eb-779f-481b-a738-4baccaeb5044-ee0a940e-6f32-43dd-9cee-47070479ade8" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-3804c4eb-779f-481b-a738-4baccaeb5044-ee0a940e-6f32-43dd-9cee-47070479ade8" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Creating volume ee0a940e-6f32-43dd-9cee-47070479ade8 from snapshot 3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-ee0a940e-6f32-43dd-9cee-47070479ade8" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-ee0a940e-6f32-43dd-9cee-47070479ade8" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] snapshot: 3804c4eb-779f-481b-a738-4baccaeb5044, volume: ee0a940e-6f32-43dd-9cee-47070479ade8, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe41d3b0-fb91-4175-ad73-84a94cb7e2b5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:18 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 Apr 10 18:33:18 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:18 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f7626-9f5d-4168-a416-0f9416392b10]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:18 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:18 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:19 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:19 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:33:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:19 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 Apr 10 18:33:19 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:21 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8" returned: 0 in 1.937s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5557090-1ad6-4bb0-af31-72a910a822e3]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:21 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:21 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:21 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.584s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:21 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:33:21 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Converted 1024.00 MB image at 528.33 MB/s Apr 10 18:33:21 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 is being set with open permissions: ugo+rw Apr 10 18:33:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:21 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 Apr 10 18:33:21 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:22 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8" returned: 0 in 0.398s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-ee0a940e-6f32-43dd-9cee-47070479ade8" released by "_copy_volume_from_snapshot" :: held 3.917s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-3804c4eb-779f-481b-a738-4baccaeb5044-ee0a940e-6f32-43dd-9cee-47070479ade8" released by "_create_volume_from_snapshot" :: held 3.935s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.943s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f14f6ec-f3c8-47c3-aa52-2d2d5b78560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0a940e-6f32-43dd-9cee-47070479ade8', 'volume_size': 1, 'snapshot_id': '3804c4eb-779f-481b-a738-4baccaeb5044'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0e5369-359b-48bc-88e6-d33fe0c9e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:22 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Volume volume-ee0a940e-6f32-43dd-9cee-47070479ade8 (ee0a940e-6f32-43dd-9cee-47070479ade8): created successfully Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0e5369-359b-48bc-88e6-d33fe0c9e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (5f4ecbf5-1a48-4357-a5ca-bea8b9598d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:22 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0a760c9e-862c-49d1-b57e-8725cc13ff9e tempest-VolumeDependencyTests-930020233 None] Created volume successfully. Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-3804c4eb-779f-481b-a738-4baccaeb5044-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-3804c4eb-779f-481b-a738-4baccaeb5044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-3804c4eb-779f-481b-a738-4baccaeb5044" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-3804c4eb-779f-481b-a738-4baccaeb5044" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Deleting offline snapshot 3804c4eb-779f-481b-a738-4baccaeb5044 of volume f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] snapshot_file for this snap is: volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d758d9-07a1-43d9-b20d-42bd7d6c4f77]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:22 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 Apr 10 18:33:22 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:22 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[06624916-b4e8-44db-ba6d-5be95bed22de]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:23 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:23 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:23 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.466s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:23 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 Apr 10 18:33:23 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:23 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:23 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044 Apr 10 18:33:23 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:24 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d.3804c4eb-779f-481b-a738-4baccaeb5044" returned: 0 in 0.399s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-3804c4eb-779f-481b-a738-4baccaeb5044" released by "_delete_snapshot" :: held 1.830s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" released by "delete_snapshot" :: held 1.839s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Created reservations ['1cb24715-faf8-4c3a-a4bb-8778c0384e11', 'da69d3fc-c097-43c4-9f34-4021994b8366', '66556214-99e2-4537-8484-c74b3ac282b7', 'd4494a2d-e825-43e4-9d53-935df3896e2f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:24 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Delete snapshot completed successfully. Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-6458c12a-4341-4dc1-8682-f28b6f538d48 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-3804c4eb-779f-481b-a738-4baccaeb5044-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ced7b57-3071-487c-92e3-e7a96d8103cc]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:24 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:24 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:25 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:25 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d Apr 10 18:33:25 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:25 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" returned: 0 in 0.417s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d" released by "delete_volume" :: held 0.915s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Created reservations ['7548dac9-82b8-4598-8564-56eff8e4c3a0', 'c107cea8-f1a5-48e3-b18d-0b07c609c48e', '47025205-aad2-43a9-9cb8-a13a93076389', '7138be13-e30c-4bdc-a65f-df3af1e45a4c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:25 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:25 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (b4613e9a-308d-4f60-892d-68d78df5b064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e9713f-1782-4b89-8f15-c9ef5334f205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e9713f-1782-4b89-8f15-c9ef5334f205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-55319843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5db7970-a9b0-4885-b9f8-304aef20668d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20594125aba84a0fab3218cb6d0ceba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:26Z,use_quota=True,user_id='95402df510634b63b4cf2f35b9416b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f2f0ef-c80e-4dcb-b526-49c596688d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f2f0ef-c80e-4dcb-b526-49c596688d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a60c162-772d-4b72-ab89-a521a8712747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a60c162-772d-4b72-ab89-a521a8712747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5db7970-a9b0-4885-b9f8-304aef20668d', 'volume_name': 'volume-e5db7970-a9b0-4885-b9f8-304aef20668d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab6626f-4f2d-4b8d-8b03-a2e9c96646aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab6626f-4f2d-4b8d-8b03-a2e9c96646aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90839b5c-3664-4334-863c-020344efbe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:25 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Volume e5db7970-a9b0-4885-b9f8-304aef20668d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5db7970-a9b0-4885-b9f8-304aef20668d', 'volume_size': 1} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-55319843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5db7970-a9b0-4885-b9f8-304aef20668d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20594125aba84a0fab3218cb6d0ceba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:26Z,use_quota=True,user_id='95402df510634b63b4cf2f35b9416b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Creating volume e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:25 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:25 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d 1073741824 Apr 10 18:33:25 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:25 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:25 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Deleted volume successfully. Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-093c4fd4-6321-46b2-927c-4d0d09cb25e1 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-f4a08ac9-5f5c-4baf-9e0f-0c876c13899d-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:26 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d 1073741824" returned: 0 in 0.473s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:26 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:26 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:26 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.411s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90839b5c-3664-4334-863c-020344efbe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5db7970-a9b0-4885-b9f8-304aef20668d', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7655f8b7-acc3-499b-bc97-1e7d0e7d5622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:26 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Volume volume-e5db7970-a9b0-4885-b9f8-304aef20668d (e5db7970-a9b0-4885-b9f8-304aef20668d): created successfully Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7655f8b7-acc3-499b-bc97-1e7d0e7d5622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (b4613e9a-308d-4f60-892d-68d78df5b064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:26 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-dab82ef6-61bd-4960-81a2-a02d146c0170 tempest-VolumeDependencyTests-930020233 None] Created volume successfully. Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (454428be-8a15-4d87-9ee9-03f20cc9a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87be158f-0d5c-4b1a-a653-cf95c27457d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87be158f-0d5c-4b1a-a653-cf95c27457d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-183520106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b643f1f-9147-44d2-a5b6-e4b2c576650f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20594125aba84a0fab3218cb6d0ceba8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e5db7970-a9b0-4885-b9f8-304aef20668d,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:27Z,use_quota=True,user_id='95402df510634b63b4cf2f35b9416b27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc4904c-9159-4fa4-9976-c56dcddc7c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc4904c-9159-4fa4-9976-c56dcddc7c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae58549-9990-4b32-8c85-7feaf81a997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae58549-9990-4b32-8c85-7feaf81a997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7b643f1f-9147-44d2-a5b6-e4b2c576650f', 'volume_name': 'volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f', 'volume_size': 1, 'source_volid': 'e5db7970-a9b0-4885-b9f8-304aef20668d', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e5ab55-8e3a-49e0-8a60-c9f9eac86e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e5ab55-8e3a-49e0-8a60-c9f9eac86e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cb6d36-80a6-4709-8a2c-4755a1127c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:27 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Volume 7b643f1f-9147-44d2-a5b6-e4b2c576650f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f', 'volume_size': 1, 'source_volid': 'e5db7970-a9b0-4885-b9f8-304aef20668d', 'source_volstatus': 'available'} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:27 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Cloning volume e5db7970-a9b0-4885-b9f8-304aef20668d to volume 7b643f1f-9147-44d2-a5b6-e4b2c576650f Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Creating offline snapshot f1190825-0dfe-4292-b54f-92ab83e9f26e of volume e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472c15e-3194-4a23-a7a7-bfd3eceb4272]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:27 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:27 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:27 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.484s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:27 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e 1G Apr 10 18:33:27 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:28 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e 1G" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5db7970-a9b0-4885-b9f8-304aef20668d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:28 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5db7970-a9b0-4885-b9f8-304aef20668d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e Apr 10 18:33:28 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:28 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5db7970-a9b0-4885-b9f8-304aef20668d -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e" returned: 0 in 0.420s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:28 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e is being set with open permissions: ugo+rw Apr 10 18:33:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:28 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e Apr 10 18:33:28 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:29 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e" returned: 0 in 0.401s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:29 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info Apr 10 18:33:29 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:29 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info" returned: 0 in 0.408s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:29 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info is being set with open permissions: ugo+rw Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:29 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info Apr 10 18:33:29 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:29 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.info" returned: 0 in 0.397s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-7b643f1f-9147-44d2-a5b6-e4b2c576650f" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-7b643f1f-9147-44d2-a5b6-e4b2c576650f" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] snapshot: f1190825-0dfe-4292-b54f-92ab83e9f26e, volume: 7b643f1f-9147-44d2-a5b6-e4b2c576650f, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60eae9-0ce7-454c-9383-025e42ef5816]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:30 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e Apr 10 18:33:30 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:30 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e" returned: 0 in 0.458s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5db7970-a9b0-4885-b9f8-304aef20668d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c6473c-8943-42ff-ad33-1590f830719b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:30 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:30 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:30 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:33:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:30 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f Apr 10 18:33:30 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:32 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f" returned: 0 in 1.868s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:32 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[4050405b-3fa7-4457-b181-2f3ddb1152ff]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:32 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:32 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:33 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.587s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d, size 1024.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:33:33 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Converted 1024.00 MB image at 547.70 MB/s Apr 10 18:33:33 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f is being set with open permissions: ugo+rw Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:33 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f Apr 10 18:33:33 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:33 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f" returned: 0 in 0.397s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-7b643f1f-9147-44d2-a5b6-e4b2c576650f" released by "_copy_volume_from_snapshot" :: held 3.812s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-f1190825-0dfe-4292-b54f-92ab83e9f26e" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-f1190825-0dfe-4292-b54f-92ab83e9f26e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Deleting offline snapshot f1190825-0dfe-4292-b54f-92ab83e9f26e of volume e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] snapshot_file for this snap is: volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e0dc0-e19f-4154-b8da-93acc4ebfab2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:33 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e Apr 10 18:33:33 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:34 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:34 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5db7970-a9b0-4885-b9f8-304aef20668d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:33:34 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe67b6d-103a-49d3-a7fd-325d81a96fc7]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:34 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:34 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:34 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.459s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:34 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e Apr 10 18:33:34 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:35 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e" returned: 0 in 0.435s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:35 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e Apr 10 18:33:35 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:35 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d.f1190825-0dfe-4292-b54f-92ab83e9f26e" returned: 0 in 0.399s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-f1190825-0dfe-4292-b54f-92ab83e9f26e" released by "_delete_snapshot" :: held 1.784s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.302s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cb6d36-80a6-4709-8a2c-4755a1127c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f', 'volume_size': 1, 'source_volid': 'e5db7970-a9b0-4885-b9f8-304aef20668d', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3d3f92-2ab6-4408-97bc-4f8bd362a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:35 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Volume volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f (7b643f1f-9147-44d2-a5b6-e4b2c576650f): created successfully Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3d3f92-2ab6-4408-97bc-4f8bd362a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:35 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Flow 'volume_create_manager' (454428be-8a15-4d87-9ee9-03f20cc9a623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:35 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fa35b88c-38d4-4daf-96fa-ac643a3f7bdb tempest-VolumeDependencyTests-930020233 None] Created volume successfully. Apr 10 18:33:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-e5db7970-a9b0-4885-b9f8-304aef20668d-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-e5db7970-a9b0-4885-b9f8-304aef20668d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-e5db7970-a9b0-4885-b9f8-304aef20668d" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:36 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-e5db7970-a9b0-4885-b9f8-304aef20668d" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a33eb1-5fd6-4e32-8554-02a15bb1d282]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:36 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:36 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:37 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:37 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d Apr 10 18:33:37 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:37 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-e5db7970-a9b0-4885-b9f8-304aef20668d" returned: 0 in 0.406s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-e5db7970-a9b0-4885-b9f8-304aef20668d" released by "delete_volume" :: held 0.894s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Created reservations ['89c40648-88a0-4be0-a428-9718515023cf', '4eeb3691-1acb-48a4-881d-dac15268007e', '14ef0dd7-c29c-4022-b924-b8b426b06cab', 'a8e10248-14a4-4036-a2f8-e5ec85c4ffc4'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:37 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:37 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-7b643f1f-9147-44d2-a5b6-e4b2c576650f-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Lock "cinder-7b643f1f-9147-44d2-a5b6-e4b2c576650f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-7b643f1f-9147-44d2-a5b6-e4b2c576650f" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-7b643f1f-9147-44d2-a5b6-e4b2c576650f" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7e626-e7dd-4efd-a555-6847c0ce5448]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:37 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f Apr 10 18:33:37 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:38 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.419s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:38 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Deleted volume successfully. Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b2ce4d3d-8a7b-4476-9e83-182a82517df3 tempest-VolumeDependencyTests-930020233 None] Lock "cinder-e5db7970-a9b0-4885-b9f8-304aef20668d-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:38 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f" returned: 0 in 0.473s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:38 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f Apr 10 18:33:38 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:38 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7b643f1f-9147-44d2-a5b6-e4b2c576650f" returned: 0 in 0.396s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-7b643f1f-9147-44d2-a5b6-e4b2c576650f" released by "delete_volume" :: held 0.889s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Created reservations ['7c1ee00c-e646-4fcf-9023-7194e82b7a49', '6160c929-d4e3-42dd-a6e3-4d6342b7ecae', '157b8f81-4a43-4df5-92c2-52a8cb43bc70', '34d6fbc2-0994-4158-a576-ac5452fcddc4'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:38 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:38 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-ee0a940e-6f32-43dd-9cee-47070479ade8-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Lock "cinder-ee0a940e-6f32-43dd-9cee-47070479ade8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Acquiring lock "cinder-quobyte-ee0a940e-6f32-43dd-9cee-47070479ade8" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-ee0a940e-6f32-43dd-9cee-47070479ade8" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b973f-246b-4bec-9067-f27db5a5be23]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:39 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 Apr 10 18:33:39 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:39 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.447s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:39 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Deleted volume successfully. Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5134004d-0936-4d98-a77f-fbcee328522d tempest-VolumeDependencyTests-930020233 None] Lock "cinder-7b643f1f-9147-44d2-a5b6-e4b2c576650f-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:39 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:39 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8 Apr 10 18:33:39 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:39 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ee0a940e-6f32-43dd-9cee-47070479ade8" returned: 0 in 0.409s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Lock "cinder-quobyte-ee0a940e-6f32-43dd-9cee-47070479ade8" released by "delete_volume" :: held 0.914s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Created reservations ['844a6c13-59c5-4316-bba6-0f181043daed', '86346079-2f79-48f7-a71f-c3eb7ee32fec', '04a9842e-f481-4df6-9a3a-67cdb837c2f3', '1b9d7e01-79ec-49f5-8049-d72cd2f53cae'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:40 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:40 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:40 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.464s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:40 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:40 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Deleted volume successfully. Apr 10 18:33:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f1bba63a-2818-47f8-bea1-5d142ca4316f tempest-VolumeDependencyTests-930020233 None] Lock "cinder-ee0a940e-6f32-43dd-9cee-47070479ade8-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:46 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (8865e942-11ed-4432-adf7-079b5863e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566af6f5-36e2-48b4-82be-42fd3cf7c17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (566af6f5-36e2-48b4-82be-42fd3cf7c17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582943082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5834cad9-759c-473b-be40-eb10963561e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ba599e-5f63-47f9-86cd-bebbb15b8b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ba599e-5f63-47f9-86cd-bebbb15b8b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60353aab-7068-469f-ae12-eee9726e7c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60353aab-7068-469f-ae12-eee9726e7c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5834cad9-759c-473b-be40-eb10963561e9', 'volume_name': 'volume-5834cad9-759c-473b-be40-eb10963561e9', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d54d85e-66f5-4609-91ff-e8360ca887ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d54d85e-66f5-4609-91ff-e8360ca887ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6aaebd-bd5a-46fd-b775-486ba2d9ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume 5834cad9-759c-473b-be40-eb10963561e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5834cad9-759c-473b-be40-eb10963561e9', 'volume_size': 1} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1582943082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5834cad9-759c-473b-be40-eb10963561e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating volume 5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:47 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (c463d7a1-dbaf-48d8-aeb1-4ad702162614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffeefdc-fae4-4160-999f-a25e381e5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 1073741824 Apr 10 18:33:47 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffeefdc-fae4-4160-999f-a25e381e5c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1086868239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169082b0f4fa43a182ff698a31ed6e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='dcdf83080d104445a7641029db27d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a225c744-26bf-47c1-a1a5-8575edc1748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a225c744-26bf-47c1-a1a5-8575edc1748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4980f3-a095-4276-a9d1-83d992d7e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4980f3-a095-4276-a9d1-83d992d7e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54', 'volume_name': 'volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd85aa0c-a5c6-4046-9c27-087279e4fb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd85aa0c-a5c6-4046-9c27-087279e4fb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf316aff-bcf6-4239-8282-29bfdace1bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Volume 2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54', 'volume_size': 1} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (1f21a5d9-fab6-43b6-a783-1d6a2bb30faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e996c122-724e-48e2-9d96-b715961d67ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e996c122-724e-48e2-9d96-b715961d67ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-691640813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c822f5-5414-4518-812f-a1adc5cf8b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90d226d-dce9-40ca-b6f6-7e3971406231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d90d226d-dce9-40ca-b6f6-7e3971406231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fd8050-fe28-4ff2-a6c1-90be522ff1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fd8050-fe28-4ff2-a6c1-90be522ff1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c822f5-5414-4518-812f-a1adc5cf8b8c', 'volume_name': 'volume-19c822f5-5414-4518-812f-a1adc5cf8b8c', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce5bdf5-0f96-4551-aefb-ff8472e62e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce5bdf5-0f96-4551-aefb-ff8472e62e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880184a3-c8f6-406f-8c37-393c87cce546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Volume 19c822f5-5414-4518-812f-a1adc5cf8b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c822f5-5414-4518-812f-a1adc5cf8b8c', 'volume_size': 1} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (978640a5-8264-4915-b880-88ffc44dcb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd61f1d-6638-4c0b-84f4-4a08a2420bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd61f1d-6638-4c0b-84f4-4a08a2420bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-524517265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50405bc-50f8-44b6-969a-49e7dca57314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c527288d-b17e-4384-bddf-272ec1a74df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c527288d-b17e-4384-bddf-272ec1a74df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0fe3e1-bb25-4970-a3ba-a11a476acf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e0fe3e1-bb25-4970-a3ba-a11a476acf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50405bc-50f8-44b6-969a-49e7dca57314', 'volume_name': 'volume-a50405bc-50f8-44b6-969a-49e7dca57314', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0766ef07-cb56-4ded-8837-75b9e010132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0766ef07-cb56-4ded-8837-75b9e010132a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50e314a-75d9-40d0-9e5f-f07a5d11f4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Volume a50405bc-50f8-44b6-969a-49e7dca57314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50405bc-50f8-44b6-969a-49e7dca57314', 'volume_size': 1} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:47 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 1073741824" returned: 0 in 0.611s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:47 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 Apr 10 18:33:47 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (5d3ca412-0798-4943-b4ab-31046eae7e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2085e16f-07f6-46c4-bad7-df4eaf01aca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2085e16f-07f6-46c4-bad7-df4eaf01aca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005220292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ed62c4-df04-4521-a9d0-663c74688aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:48Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014b0141-93da-45c0-ba7f-e5c4b4ee9514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014b0141-93da-45c0-ba7f-e5c4b4ee9514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39cf560-db7f-44db-9ec8-2646a23eeb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39cf560-db7f-44db-9ec8-2646a23eeb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ed62c4-df04-4521-a9d0-663c74688aa3', 'volume_name': 'volume-b3ed62c4-df04-4521-a9d0-663c74688aa3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dcb3d4-c9bd-4310-850f-6f2122a997f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86dcb3d4-c9bd-4310-850f-6f2122a997f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916691cd-203e-4fea-9c87-79414a6b8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Volume b3ed62c4-df04-4521-a9d0-663c74688aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ed62c4-df04-4521-a9d0-663c74688aa3', 'volume_size': 1} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (c193612b-f962-4c0d-abea-bc0ef3e5edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431dab2a-9901-4b88-8e3e-df35b8c6e3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431dab2a-9901-4b88-8e3e-df35b8c6e3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634832802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160fa24a-fb6f-4375-b65d-a75304a47502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:48Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:47 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d3dd98-2983-4b0e-b2c5-aa68a95cf02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d3dd98-2983-4b0e-b2c5-aa68a95cf02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4994a174-7b1e-42fe-b199-1a6e6992338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4994a174-7b1e-42fe-b199-1a6e6992338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160fa24a-fb6f-4375-b65d-a75304a47502', 'volume_name': 'volume-160fa24a-fb6f-4375-b65d-a75304a47502', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385859cd-f81a-4b4d-91d9-194d7bf4462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385859cd-f81a-4b4d-91d9-194d7bf4462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae24ba1-94e9-4b21-a94f-b41afeb917f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Volume 160fa24a-fb6f-4375-b65d-a75304a47502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160fa24a-fb6f-4375-b65d-a75304a47502', 'volume_size': 1} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (9438c79b-2e8b-465b-ba7a-95a97064ab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed52715b-82db-491c-bbd1-f4ae33483021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed52715b-82db-491c-bbd1-f4ae33483021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817315226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4b3362-aa56-4ff7-a127-8c1f9b3516fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:48Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195f3c01-a4d5-45fa-9eb9-40838019e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195f3c01-a4d5-45fa-9eb9-40838019e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e208c24-5d18-4676-a607-88e3d495ac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e208c24-5d18-4676-a607-88e3d495ac62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4b3362-aa56-4ff7-a127-8c1f9b3516fd', 'volume_name': 'volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128ca3cc-7736-45e6-ba08-81cdc81baaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128ca3cc-7736-45e6-ba08-81cdc81baaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869858c-328b-4cba-a5a8-fdc72c877b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Volume 6e4b3362-aa56-4ff7-a127-8c1f9b3516fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd', 'volume_size': 1} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:48 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9" returned: 0 in 0.550s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1086868239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169082b0f4fa43a182ff698a31ed6e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='dcdf83080d104445a7641029db27d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Creating volume 2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:48 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6aaebd-bd5a-46fd-b775-486ba2d9ac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5834cad9-759c-473b-be40-eb10963561e9', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d210d26-df0c-443a-bfc0-d2e58b28ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:48 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 1073741824 Apr 10 18:33:48 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:48 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume volume-5834cad9-759c-473b-be40-eb10963561e9 (5834cad9-759c-473b-be40-eb10963561e9): created successfully Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d210d26-df0c-443a-bfc0-d2e58b28ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (8865e942-11ed-4432-adf7-079b5863e291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:48 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-cffdcfcf-25a9-42bb-80e0-c9f4f102ed73 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created volume successfully. Apr 10 18:33:48 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 1073741824" returned: 0 in 0.500s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:48 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:33:48 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:49 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.497s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-691640813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c822f5-5414-4518-812f-a1adc5cf8b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Creating volume 19c822f5-5414-4518-812f-a1adc5cf8b8c {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:49 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf316aff-bcf6-4239-8282-29bfdace1bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f00baa5-023e-4912-8917-14bfc3310b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:49 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c 1073741824 Apr 10 18:33:49 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:49 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Volume volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 (2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54): created successfully Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f00baa5-023e-4912-8917-14bfc3310b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (c463d7a1-dbaf-48d8-aeb1-4ad702162614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:49 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-956dbf9a-6c3c-4319-a704-304107d55753 tempest-VolumeDependencyTests-1721715164 None] Created volume successfully. Apr 10 18:33:49 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c 1073741824" returned: 0 in 0.472s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:49 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c Apr 10 18:33:49 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:50 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c" returned: 0 in 0.505s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-524517265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50405bc-50f8-44b6-969a-49e7dca57314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:47Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Creating volume a50405bc-50f8-44b6-969a-49e7dca57314 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:50 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880184a3-c8f6-406f-8c37-393c87cce546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c822f5-5414-4518-812f-a1adc5cf8b8c', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62984fa7-c1f6-4f36-b5e6-4df51287e37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:50 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 1073741824 Apr 10 18:33:50 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:50 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Volume volume-19c822f5-5414-4518-812f-a1adc5cf8b8c (19c822f5-5414-4518-812f-a1adc5cf8b8c): created successfully Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62984fa7-c1f6-4f36-b5e6-4df51287e37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (1f21a5d9-fab6-43b6-a783-1d6a2bb30faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:50 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9ffa4525-0e87-4c62-b1ce-e73515ae2e10 tempest-CreateVolumesFromImageTest-772959199 None] Created volume successfully. Apr 10 18:33:50 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 1073741824" returned: 0 in 0.515s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:50 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:50 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 Apr 10 18:33:50 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:51 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.517s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1005220292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ed62c4-df04-4521-a9d0-663c74688aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:48Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Creating volume b3ed62c4-df04-4521-a9d0-663c74688aa3 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:51 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50e314a-75d9-40d0-9e5f-f07a5d11f4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50405bc-50f8-44b6-969a-49e7dca57314', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:51 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 1073741824 Apr 10 18:33:51 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e362c4-214d-4f11-9e49-737b3242cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:51 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Volume volume-a50405bc-50f8-44b6-969a-49e7dca57314 (a50405bc-50f8-44b6-969a-49e7dca57314): created successfully Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e362c4-214d-4f11-9e49-737b3242cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (978640a5-8264-4915-b880-88ffc44dcb8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:51 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f3a5acd3-48ce-47e1-b488-2ec8effe6f65 tempest-CreateVolumesFromImageTest-772959199 None] Created volume successfully. Apr 10 18:33:51 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 1073741824" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:51 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:51 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 Apr 10 18:33:51 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:52 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.316s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1634832802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160fa24a-fb6f-4375-b65d-a75304a47502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:48Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Creating volume 160fa24a-fb6f-4375-b65d-a75304a47502 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:52 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (916691cd-203e-4fea-9c87-79414a6b8582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ed62c4-df04-4521-a9d0-663c74688aa3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1433a1-3ad8-482b-87a0-cf51ff977fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:52 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 1073741824 Apr 10 18:33:52 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Volume volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 (b3ed62c4-df04-4521-a9d0-663c74688aa3): created successfully Apr 10 18:33:52 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f1433a1-3ad8-482b-87a0-cf51ff977fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (5d3ca412-0798-4943-b4ab-31046eae7e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:52 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-33673f48-5f04-4c65-8d6b-73db520633af tempest-CreateVolumesFromImageTest-772959199 None] Created volume successfully. Apr 10 18:33:52 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 1073741824" returned: 0 in 0.555s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:52 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:52 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 Apr 10 18:33:52 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:53 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502" returned: 0 in 0.449s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.148s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817315226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e4b3362-aa56-4ff7-a127-8c1f9b3516fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5cf24c5dde4790b73159ccbbae50e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:48Z,use_quota=True,user_id='1c15d280d3c5467ea9dc382c421468eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Creating volume 6e4b3362-aa56-4ff7-a127-8c1f9b3516fd {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:33:53 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae24ba1-94e9-4b21-a94f-b41afeb917f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160fa24a-fb6f-4375-b65d-a75304a47502', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fda9c8-7976-49b5-94c9-c11527448809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:53 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd 1073741824 Apr 10 18:33:53 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:53 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Volume volume-160fa24a-fb6f-4375-b65d-a75304a47502 (160fa24a-fb6f-4375-b65d-a75304a47502): created successfully Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fda9c8-7976-49b5-94c9-c11527448809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:53 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (c193612b-f962-4c0d-abea-bc0ef3e5edcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:53 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-635eea84-ff2b-42ba-8fc2-932f139d9f46 tempest-CreateVolumesFromImageTest-772959199 None] Created volume successfully. Apr 10 18:33:53 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd 1073741824" returned: 0 in 0.606s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:54 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd Apr 10 18:33:54 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:54 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd" returned: 0 in 0.486s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.240s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869858c-328b-4cba-a5a8-fdc72c877b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b71514-380b-4b94-8c08-a20548fc537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating offline snapshot d76b7dd3-1b81-4300-b049-a552d5e1886f of volume 5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6031268a-663b-42a3-a06b-0930cb3a9724]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:54 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Volume volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd (6e4b3362-aa56-4ff7-a127-8c1f9b3516fd): created successfully Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b71514-380b-4b94-8c08-a20548fc537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Flow 'volume_create_manager' (9438c79b-2e8b-465b-ba7a-95a97064ab69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:54 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-323a5598-80c3-4581-b289-ebaf117339c6 tempest-CreateVolumesFromImageTest-772959199 None] Created volume successfully. Apr 10 18:33:54 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 Apr 10 18:33:54 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-quobyte-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e962c558-ab09-474c-9a95-d861954f4d18]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:54 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:54 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd Apr 10 18:33:54 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:55 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9" returned: 0 in 0.597s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:55 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f 1G Apr 10 18:33:55 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:55 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:55 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd Apr 10 18:33:55 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:55 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f 1G" returned: 0 in 0.499s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5834cad9-759c-473b-be40-eb10963561e9 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:55 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5834cad9-759c-473b-be40-eb10963561e9 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f Apr 10 18:33:55 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:55 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd" returned: 0 in 0.449s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd" released by "delete_volume" :: held 1.004s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Created reservations ['ad234f1c-95c2-4b5b-8cf5-ff727871e33f', 'e7eb52b8-4e19-4687-bd77-daa79d59cf78', 'a18f15c1-1e3d-4f2f-ab42-de676f6dbca9', 'f236fffd-0fd1-4c7a-8d09-25f7dda0eb73'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:55 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:55 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:55 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:56 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5834cad9-759c-473b-be40-eb10963561e9 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:56 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f is being set with open permissions: ugo+rw Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:56 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f Apr 10 18:33:56 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:56 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:56 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Deleted volume successfully. Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-9497920f-02da-4093-933d-ae112a6c0d53 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-6e4b3362-aa56-4ff7-a127-8c1f9b3516fd-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:56 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f" returned: 0 in 0.434s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:56 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info Apr 10 18:33:56 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-160fa24a-fb6f-4375-b65d-a75304a47502-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-160fa24a-fb6f-4375-b65d-a75304a47502-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-quobyte-160fa24a-fb6f-4375-b65d-a75304a47502" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-160fa24a-fb6f-4375-b65d-a75304a47502" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6999f660-6ca0-471b-ab01-400c78201d4d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:56 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:57 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 Apr 10 18:33:57 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:57 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:57 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info is being set with open permissions: ugo+rw Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:57 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info Apr 10 18:33:57 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:57 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.info" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.303s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:57 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Creating offline snapshot 81a6f93e-38a0-4918-a435-638651f5feed of volume 2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[868be0cb-085f-43ff-a804-649571272c45]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502" returned: 0 in 0.616s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:57 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-25af6f89-29f4-470b-a02c-a3b452eb7c02 tempest-CreateVolumesFromSnapshotTest-523271683 None] Create snapshot completed successfully Apr 10 18:33:57 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:57 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502 Apr 10 18:33:57 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:57 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:33:57 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:58 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-160fa24a-fb6f-4375-b65d-a75304a47502" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-160fa24a-fb6f-4375-b65d-a75304a47502" released by "delete_volume" :: held 1.108s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Created reservations ['54d777a6-9c9d-4076-9a8b-901f6ac5256d', 'b10db275-113d-4910-b12d-70c0acee7749', '45de447b-b77b-437a-920e-ac4bbd5becc0', '26b0fbab-4b53-44f3-8955-286f1bd12b83'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:58 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:33:58 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:58 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.621s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:58 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed 1G Apr 10 18:33:58 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:58 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:33:58 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Deleted volume successfully. Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-841421d0-be75-43da-ae2d-80dfe7b6a302 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-160fa24a-fb6f-4375-b65d-a75304a47502-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:33:58 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed 1G" returned: 0 in 0.619s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:58 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed Apr 10 18:33:58 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (b99eff86-2fed-44dd-8dd1-7202e626eb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:58 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d43345-0dff-4231-ac9b-369228b6dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d43345-0dff-4231-ac9b-369228b6dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1980765634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a0789-bafb-41f4-b72f-aa0e0250b77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:59Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8a2d71-f429-4596-9183-b35b6c424c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8a2d71-f429-4596-9183-b35b6c424c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abcf481-92dc-4c61-92bf-58fc09059e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abcf481-92dc-4c61-92bf-58fc09059e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7a0789-bafb-41f4-b72f-aa0e0250b77a', 'volume_name': 'volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52dc4dc-763e-4c74-b042-a50749f0daf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52dc4dc-763e-4c74-b042-a50749f0daf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466d521-0e85-4f48-bb68-ce5726df8b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume 4d7a0789-bafb-41f4-b72f-aa0e0250b77a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a', 'volume_size': 1} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-b3ed62c4-df04-4521-a9d0-663c74688aa3-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-b3ed62c4-df04-4521-a9d0-663c74688aa3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-quobyte-b3ed62c4-df04-4521-a9d0-663c74688aa3" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (f2d3e28c-fc7f-4e7a-9357-c96f0d1600f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba2e5be-eded-49ca-aa8a-1f036910a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba2e5be-eded-49ca-aa8a-1f036910a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532982959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc93389-3f29-4578-a160-dea229a452be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:59Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957c71f-9a5c-4b32-b25d-996eb061585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9957c71f-9a5c-4b32-b25d-996eb061585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933f3c28-e033-421a-b7ff-e25211dcf289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933f3c28-e033-421a-b7ff-e25211dcf289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc93389-3f29-4578-a160-dea229a452be', 'volume_name': 'volume-ecc93389-3f29-4578-a160-dea229a452be', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48254b1-a5cb-41bc-b7de-aa6a56b2c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48254b1-a5cb-41bc-b7de-aa6a56b2c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85c6beb-ce2c-4d27-a497-466ae8a49fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume ecc93389-3f29-4578-a160-dea229a452be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc93389-3f29-4578-a160-dea229a452be', 'volume_size': 1} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-b3ed62c4-df04-4521-a9d0-663c74688aa3" acquired by "delete_volume" :: waited 0.086s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe6a5a-39b3-46e6-8b75-4c03c6ff1fa2]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:59 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 Apr 10 18:33:59 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (4800a2d5-907d-4834-bba4-5398d01ff6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb62d111-4294-4bce-a878-d0b5a7fdec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb62d111-4294-4bce-a878-d0b5a7fdec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286574532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a50add-d987-4f04-b89f-32161045c5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:00Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbfcc85-4618-4ce6-8532-ca774abdbdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbbfcc85-4618-4ce6-8532-ca774abdbdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26027e1-f813-4095-ad05-fe352153921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26027e1-f813-4095-ad05-fe352153921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a50add-d987-4f04-b89f-32161045c5f2', 'volume_name': 'volume-a6a50add-d987-4f04-b89f-32161045c5f2', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99eea60e-1d61-4c37-81b3-847919b08c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99eea60e-1d61-4c37-81b3-847919b08c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c47c6d-5faf-4921-833c-8327dc7dca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:33:59 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume a6a50add-d987-4f04-b89f-32161045c5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a50add-d987-4f04-b89f-32161045c5f2', 'volume_size': 1} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed" returned: 0 in 0.950s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:33:59 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed is being set with open permissions: ugo+rw Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:33:59 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed Apr 10 18:33:59 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:33:59 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (c75be34d-61df-4743-9b3d-c31b85d2e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50f4d0b-b226-4d3c-85d8-9f4e118027f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50f4d0b-b226-4d3c-85d8-9f4e118027f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720355519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb2fbd8-4270-4d4d-b36b-26a47474e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:00Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653dd917-3c67-40bf-8ec9-cc34bfe5fcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (653dd917-3c67-40bf-8ec9-cc34bfe5fcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcc2ca9-e823-43e0-9506-026a81f04a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcc2ca9-e823-43e0-9506-026a81f04a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffb2fbd8-4270-4d4d-b36b-26a47474e6c3', 'volume_name': 'volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05bf59e-28df-46cc-bf57-d0e78fbbfe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05bf59e-28df-46cc-bf57-d0e78fbbfe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9025a90b-5509-4a0d-a5d6-f7bcbb0683bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume ffb2fbd8-4270-4d4d-b36b-26a47474e6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3', 'volume_size': 1} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:00 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (35ccb17a-c756-4e6a-94ca-2334f0e34e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6557cb-476c-4497-a80d-b0bf7173926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3" returned: 0 in 0.850s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6557cb-476c-4497-a80d-b0bf7173926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-748233030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:00Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b9e7e0-2ad2-4b9b-b836-555843138fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b9e7e0-2ad2-4b9b-b836-555843138fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5944fb84-6b98-41d7-9aa1-281ce8d29a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3 Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5944fb84-6b98-41d7-9aa1-281ce8d29a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4', 'volume_name': 'volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b23309-a5f8-410a-8161-60be1c2284d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b23309-a5f8-410a-8161-60be1c2284d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e4922-dfa8-4c7a-9d9b-f6ec789f7f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:00 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4', 'volume_size': 1} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:00 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed" returned: 0 in 0.565s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:00 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info Apr 10 18:34:00 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:00 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b3ed62c4-df04-4521-a9d0-663c74688aa3" returned: 0 in 0.696s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-b3ed62c4-df04-4521-a9d0-663c74688aa3" released by "delete_volume" :: held 1.570s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:00 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:00 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info is being set with open permissions: ugo+rw Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Created reservations ['815c179e-0a3d-41f4-af82-f573bf07f8c2', '7ee17208-df30-45e1-91c9-36d90a7736ad', 'ee1bdd6d-a390-4c43-b44f-6ecdc0a560b1', 'e2dcaf14-7fbd-4679-b37e-4ce62fd6088f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:00 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info Apr 10 18:34:00 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:00 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:01 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:01 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Flow 'volume_create_manager' (c6b675be-e0c9-4f4b-8238-4fb500a9336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6ffb8e-38e5-46d0-940b-f0204d0c21f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6ffb8e-38e5-46d0-940b-f0204d0c21f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1957926667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7392d9ed-e2b9-4653-827f-1361dd78e3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050235f606214597b0de9a8ed87513e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:01Z,use_quota=True,user_id='2ad128db3095497aa23c699a34f5d87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45580c6f-d1f6-48f9-889f-40cad4812207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45580c6f-d1f6-48f9-889f-40cad4812207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeba7048-e69a-4110-9cd3-bb5715feddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeba7048-e69a-4110-9cd3-bb5715feddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7392d9ed-e2b9-4653-827f-1361dd78e3aa', 'volume_name': 'volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaf0f9e-4056-41d8-9acf-7809a89bcabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaf0f9e-4056-41d8-9acf-7809a89bcabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73148cc2-288d-4bba-b07c-df953eab5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Volume 7392d9ed-e2b9-4653-827f-1361dd78e3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa', 'volume_size': 1} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:01 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.info" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.795s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.285s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1980765634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7a0789-bafb-41f4-b72f-aa0e0250b77a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:59Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating volume 4d7a0789-bafb-41f4-b72f-aa0e0250b77a {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:01 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-a50405bc-50f8-44b6-969a-49e7dca57314-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:01 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a 1073741824 Apr 10 18:34:01 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0db2eb6b-891e-4cf5-a56f-7a5cb6c3b6d4 tempest-VolumeDependencyTests-1721715164 None] Create snapshot completed successfully Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-a50405bc-50f8-44b6-969a-49e7dca57314-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-quobyte-a50405bc-50f8-44b6-969a-49e7dca57314" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-a50405bc-50f8-44b6-969a-49e7dca57314" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[74703728-eb8f-4fa9-b9a2-16158379f96d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:01 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:01 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Deleted volume successfully. Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e08a016d-cb00-4e85-a879-b55ef4c05662 tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-b3ed62c4-df04-4521-a9d0-663c74688aa3-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:01 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 Apr 10 18:34:01 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:01 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (8525d639-0223-4fc3-a338-b19fc541681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c835183-198c-4b8b-891e-afa5636b7817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a 1073741824" returned: 0 in 0.532s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c835183-198c-4b8b-891e-afa5636b7817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-146871060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169082b0f4fa43a182ff698a31ed6e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81a6f93e-38a0-4918-a435-638651f5feed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:02Z,use_quota=True,user_id='dcdf83080d104445a7641029db27d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cec48f-04af-464c-be6e-03732dfccdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cec48f-04af-464c-be6e-03732dfccdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5b0614-109b-4513-8ef8-d89f7ec5b089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5b0614-109b-4513-8ef8-d89f7ec5b089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e', 'volume_name': 'volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e', 'volume_size': 1, 'snapshot_id': '81a6f93e-38a0-4918-a435-638651f5feed'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3eec684-2472-40e4-94a5-5708f83683c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3eec684-2472-40e4-94a5-5708f83683c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56468a0b-1bbe-4b22-9615-e159a494a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:01 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Volume 85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e', 'volume_size': 1, 'snapshot_id': '81a6f93e-38a0-4918-a435-638651f5feed'} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:01 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a Apr 10 18:34:01 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:01 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314" returned: 0 in 0.533s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:01 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:02 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314 Apr 10 18:34:02 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:02 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a" returned: 0 in 0.417s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.074s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532982959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc93389-3f29-4578-a160-dea229a452be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:33:59Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating volume ecc93389-3f29-4578-a160-dea229a452be {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:02 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:02 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b466d521-0e85-4f48-bb68-ce5726df8b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:02 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be 1073741824 Apr 10 18:34:02 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c926851-e812-4cde-8315-d4003e460702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a50405bc-50f8-44b6-969a-49e7dca57314" returned: 0 in 0.428s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-a50405bc-50f8-44b6-969a-49e7dca57314" released by "delete_volume" :: held 0.982s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:02 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a (4d7a0789-bafb-41f4-b72f-aa0e0250b77a): created successfully Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c926851-e812-4cde-8315-d4003e460702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (b99eff86-2fed-44dd-8dd1-7202e626eb19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5310c6cb-4540-45ab-b7ac-b7bb37e4a9d6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created volume successfully. Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Created reservations ['78fa21f5-3fc3-422e-ac55-37d7b689109a', 'ea49355c-4f8b-4960-89e8-bd962e20adf2', 'be7c9b0e-cda1-46f2-9f5c-cc5acdf511fc', '5b4deaf4-dead-47fa-ac32-1dae8305ffe7'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:02 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:02 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:02 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be 1073741824" returned: 0 in 0.484s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:02 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be Apr 10 18:34:02 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:02 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.417s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:02 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Deleted volume successfully. Apr 10 18:34:02 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3979687d-d4e3-4d6a-a2be-e9ff75a32e7a tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-a50405bc-50f8-44b6-969a-49e7dca57314-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:03 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be" returned: 0 in 0.404s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.529s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-286574532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a50add-d987-4f04-b89f-32161045c5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:00Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating volume a6a50add-d987-4f04-b89f-32161045c5f2 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:03 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85c6beb-ce2c-4d27-a497-466ae8a49fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc93389-3f29-4578-a160-dea229a452be', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621ddbff-b943-4c41-9ed4-fe7132d5764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:03 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 1073741824 Apr 10 18:34:03 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:03 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume volume-ecc93389-3f29-4578-a160-dea229a452be (ecc93389-3f29-4578-a160-dea229a452be): created successfully Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621ddbff-b943-4c41-9ed4-fe7132d5764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (f2d3e28c-fc7f-4e7a-9357-c96f0d1600f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:03 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d6ed1314-dd33-4e96-9673-bff2ec4f06fc tempest-CreateVolumesFromSnapshotTest-523271683 None] Created volume successfully. Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-19c822f5-5414-4518-812f-a1adc5cf8b8c-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-19c822f5-5414-4518-812f-a1adc5cf8b8c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "cinder-quobyte-19c822f5-5414-4518-812f-a1adc5cf8b8c" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-19c822f5-5414-4518-812f-a1adc5cf8b8c" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d62ae7-52da-4681-a190-8a503d63df47]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:03 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c Apr 10 18:34:03 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:03 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 1073741824" returned: 0 in 0.521s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:03 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:03 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 Apr 10 18:34:03 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:04 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c" returned: 0 in 0.482s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:04 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c Apr 10 18:34:04 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:04 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.231s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720355519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffb2fbd8-4270-4d4d-b36b-26a47474e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:00Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating volume ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:04 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c47c6d-5faf-4921-833c-8327dc7dca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a50add-d987-4f04-b89f-32161045c5f2', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae07eb7-620d-4dc2-9dd9-a449b31fbdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:04 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 1073741824 Apr 10 18:34:04 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:04 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume volume-a6a50add-d987-4f04-b89f-32161045c5f2 (a6a50add-d987-4f04-b89f-32161045c5f2): created successfully Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae07eb7-620d-4dc2-9dd9-a449b31fbdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (4800a2d5-907d-4834-bba4-5398d01ff6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:04 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b81b2edd-8964-4efa-a0d6-ebea8eaf3907 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created volume successfully. Apr 10 18:34:04 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-19c822f5-5414-4518-812f-a1adc5cf8b8c" returned: 0 in 0.432s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-quobyte-19c822f5-5414-4518-812f-a1adc5cf8b8c" released by "delete_volume" :: held 0.934s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Created reservations ['2d4ff49d-a9f0-428e-94eb-912a638c06f5', '8ee21018-707d-465e-a2b6-4cbeec08d05a', '25bd33b9-80e8-4746-8b6a-6ea8ab2492f0', 'b99b1ffe-115b-4874-a11a-7f8db886e36c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:04 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:04 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:04 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 1073741824" returned: 0 in 0.502s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:04 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:04 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 Apr 10 18:34:04 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:05 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.543s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:05 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Deleted volume successfully. Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8329bf72-a560-4605-a0e6-60be137be43e tempest-CreateVolumesFromImageTest-772959199 None] Lock "cinder-19c822f5-5414-4518-812f-a1adc5cf8b8c-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:05 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.059s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-748233030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b00467747274f4b8703bf263d9054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:00Z,use_quota=True,user_id='9e662aae641a421d9128f2edee521b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Creating volume f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:05 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9025a90b-5509-4a0d-a5d6-f7bcbb0683bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:05 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 1073741824 Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05285c6-c0b6-40c9-9130-a81e73e3ecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:05 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:05 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 (ffb2fbd8-4270-4d4d-b36b-26a47474e6c3): created successfully Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05285c6-c0b6-40c9-9130-a81e73e3ecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (c75be34d-61df-4743-9b3d-c31b85d2e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:05 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fd8e6d08-2fc0-4cdd-9072-880cc66f01a6 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created volume successfully. Apr 10 18:34:05 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 1073741824" returned: 0 in 0.548s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=103,cinder:INSERT=26,cinder:UPDATE=119,cinder:DELETE=12 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=105,cinder:UPDATE=157,cinder:INSERT=37,cinder:DELETE=16 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:34:05 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:05 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 Apr 10 18:34:05 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:06 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4" returned: 0 in 0.548s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.242s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1957926667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7392d9ed-e2b9-4653-827f-1361dd78e3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050235f606214597b0de9a8ed87513e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:01Z,use_quota=True,user_id='2ad128db3095497aa23c699a34f5d87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Creating volume 7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:06 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e4922-dfa8-4c7a-9d9b-f6ec789f7f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad3d21f-904b-475e-aa3b-072b3b452c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:06 devstack sudo[90179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa 1073741824 Apr 10 18:34:06 devstack sudo[90179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:06 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Volume volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 (f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4): created successfully Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad3d21f-904b-475e-aa3b-072b3b452c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Flow 'volume_create_manager' (35ccb17a-c756-4e6a-94ca-2334f0e34e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (1040f076-6cf1-4795-a78b-991b8e4ed42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20430a29-9370-4005-b60f-dd70aed9d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20430a29-9370-4005-b60f-dd70aed9d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993685856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:06Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2874cad6-c4d4-4758-8fc5-35332f891abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2874cad6-c4d4-4758-8fc5-35332f891abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327c3b8e-a561-4b17-815d-770f42c84095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327c3b8e-a561-4b17-815d-770f42c84095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f', 'volume_name': 'volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9649f6-e12e-4aa2-b0de-bd1a5a876aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9649f6-e12e-4aa2-b0de-bd1a5a876aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870aad0-ca8e-4c48-95ee-41fcdcbb6bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:06 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f', 'volume_size': 1} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:06 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-fa3a2631-e07e-4e5b-8fe8-1ced7a7b3603 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created volume successfully. Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb206e-e163-4d57-aa2e-b20eedfe5fa9]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:06 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 Apr 10 18:34:06 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:06 devstack sudo[90179]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa 1073741824" returned: 0 in 0.506s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:06 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:07 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:07 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:07 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:07 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4 Apr 10 18:34:07 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:07 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.463s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-81a6f93e-38a0-4918-a435-638651f5feed-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-81a6f93e-38a0-4918-a435-638651f5feed-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" acquired by "_create_volume_from_snapshot" :: waited 0.076s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Creating volume 85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e from snapshot 81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73148cc2-288d-4bba-b07c-df953eab5f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7251e4d8-0233-44b2-9350-4ef40b2fe2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] snapshot: 81a6f93e-38a0-4918-a435-638651f5feed, volume: 85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:34:07 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Volume volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa (7392d9ed-e2b9-4653-827f-1361dd78e3aa): created successfully Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7251e4d8-0233-44b2-9350-4ef40b2fe2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Flow 'volume_create_manager' (c6b675be-e0c9-4f4b-8238-4fb500a9336a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:07 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f9c16ddc-9e33-4b4f-a8f4-2edf0d960656 tempest-SnapshotDependencyTests-1206391521 None] Created volume successfully. Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8eea2a-0d7c-457a-a8e8-17e61c148391]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:07 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed Apr 10 18:34:07 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:07 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4" returned: 0 in 0.444s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4" released by "delete_volume" :: held 0.990s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['6763fc43-064a-4154-9477-9516d2c87618', '14d1ab42-a12d-4b7c-91fa-dae6623eb374', '12d3ded9-cf5f-4706-8080-523f5ad9d3a1', 'bb3129d1-7559-43d1-a310-5582f6fae6a0'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:07 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:07 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cce6c6-9e83-4b95-85fd-6a4473271f45]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:07 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:07 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 Apr 10 18:34:07 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:08 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2da4b2-fab5-4ea4-878b-4c74b1eb9411]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:08 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:34:08 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:08 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.442s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:08 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleted volume successfully. Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f7919a61-0e81-4cad-84f2-6f35e3ef3b19 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-f92ddcb2-a000-4ca8-a8e8-6ed9f80cbef4-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:08 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:08 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3 Apr 10 18:34:08 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:08 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.499s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:08 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e Apr 10 18:34:08 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:08 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3" returned: 0 in 0.449s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3" released by "delete_volume" :: held 0.983s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['0c659703-5c28-43f4-b27d-248286477a76', '8de8f6e5-2145-475d-b2d7-3a41aa075c09', 'c2f19a3b-54d7-4b62-b742-041e4f075a88', '7409939c-0f55-4075-8003-78c7ffe157f3'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:08 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:08 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-a6a50add-d987-4f04-b89f-32161045c5f2-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-a6a50add-d987-4f04-b89f-32161045c5f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-a6a50add-d987-4f04-b89f-32161045c5f2" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-a6a50add-d987-4f04-b89f-32161045c5f2" acquired by "delete_volume" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eead59-ebc9-4e36-bf11-3cdf1094ee0f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:08 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:09 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 Apr 10 18:34:09 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:09 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:09 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.698s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:09 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:09 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleted volume successfully. Apr 10 18:34:09 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-f01caa62-9309-47a3-b6ff-3db3d0e351fa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-ffb2fbd8-4270-4d4d-b36b-26a47474e6c3-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:10 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2" returned: 0 in 1.807s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:10 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2 Apr 10 18:34:10 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:10 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" returned: 0 in 2.294s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:10 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c58d38-dbea-4c63-b267-b1ef99232af5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:10 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:10 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:34:10 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:11 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a6a50add-d987-4f04-b89f-32161045c5f2" returned: 0 in 0.431s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-a6a50add-d987-4f04-b89f-32161045c5f2" released by "delete_volume" :: held 2.259s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['6506434c-3fd1-4f56-af6e-ca2fe8ac4aa0', '7ec6e691-bed5-46b4-a6d6-6367166222a1', '2827c036-8fcd-486f-9630-5c46fd04d2bf', '4de92dda-2eb7-4ec5-b939-1478b1931212'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:11 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:11 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:11 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.648s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54, size 1024.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:34:11 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Converted 1024.00 MB image at 445.96 MB/s Apr 10 18:34:11 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e is being set with open permissions: ugo+rw Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:11 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e Apr 10 18:34:11 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:11 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:11 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleted volume successfully. Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-285bbf95-811c-4143-a3b4-5842d2efdf3f tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-a6a50add-d987-4f04-b89f-32161045c5f2-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:11 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" returned: 0 in 0.429s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" released by "_copy_volume_from_snapshot" :: held 4.447s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-81a6f93e-38a0-4918-a435-638651f5feed-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" released by "_create_volume_from_snapshot" :: held 4.473s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.549s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.392s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-993685856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:06Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Creating volume bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:11 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:11 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:12 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f 1073741824 Apr 10 18:34:12 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56468a0b-1bbe-4b22-9615-e159a494a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e', 'volume_size': 1, 'snapshot_id': '81a6f93e-38a0-4918-a435-638651f5feed'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750526d8-b242-46f4-9145-d03ab4363dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:12 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Volume volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e (85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e): created successfully Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750526d8-b242-46f4-9145-d03ab4363dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (8525d639-0223-4fc3-a338-b19fc541681b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:12 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-5e1ef04a-fdef-4149-bf56-dfe28cd8992f tempest-VolumeDependencyTests-1721715164 None] Created volume successfully. Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-ecc93389-3f29-4578-a160-dea229a452be-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-ecc93389-3f29-4578-a160-dea229a452be-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-ecc93389-3f29-4578-a160-dea229a452be" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-ecc93389-3f29-4578-a160-dea229a452be" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[317d651e-420d-45cf-9662-bbc92d7d5933]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:12 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be Apr 10 18:34:12 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:12 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f 1073741824" returned: 0 in 0.529s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:12 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f Apr 10 18:34:12 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-81a6f93e-38a0-4918-a435-638651f5feed-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-81a6f93e-38a0-4918-a435-638651f5feed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-81a6f93e-38a0-4918-a435-638651f5feed" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-81a6f93e-38a0-4918-a435-638651f5feed" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Deleting offline snapshot 81a6f93e-38a0-4918-a435-638651f5feed of volume 2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] snapshot_file for this snap is: volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20235c-8e54-4df8-89db-788b3eedd22d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:12 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed Apr 10 18:34:12 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:12 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be" returned: 0 in 0.519s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:12 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be Apr 10 18:34:12 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:12 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f" returned: 0 in 0.455s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:12 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.339s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870aad0-ca8e-4c48-95ee-41fcdcbb6bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5c2cf0-d2bb-4153-ba36-2393cdb726d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Creating offline snapshot f92415b0-a447-421b-8055-1341fe12e61c of volume 7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:34:13 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f (bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f): created successfully Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5c2cf0-d2bb-4153-ba36-2393cdb726d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (1040f076-6cf1-4795-a78b-991b8e4ed42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b788f28b-fb37-4673-947c-823206c571d4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:13 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-ccfd16f3-6730-4bc8-8682-0b8704bbf23c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created volume successfully. Apr 10 18:34:13 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:13 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:13 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed" returned: 0 in 0.530s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:13 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ecc93389-3f29-4578-a160-dea229a452be" returned: 0 in 0.434s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde634e5-2048-430e-b30c-519ddd7d08ae]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-ecc93389-3f29-4578-a160-dea229a452be" released by "delete_volume" :: held 0.997s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['8fda0233-6bfa-425f-858b-6325eca4b6e4', '87f28b1d-c5d7-4cb9-9f99-9616de7148e1', 'ebf0df51-81e3-44f8-aab2-0f0383eb6bbf', 'a8dd216f-958f-4459-a4ed-00b22fe23faf'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:13 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:34:13 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:13 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:13 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:13 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.512s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:13 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c 1G Apr 10 18:34:13 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:13 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.483s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:13 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed Apr 10 18:34:13 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:13 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.456s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:13 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleted volume successfully. Apr 10 18:34:13 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-668e87c6-1e5b-4596-981f-c7a087c19b2b tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-ecc93389-3f29-4578-a160-dea229a452be-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:14 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c 1G" returned: 0 in 0.515s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:14 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c Apr 10 18:34:14 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:14 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed" returned: 0 in 0.545s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:14 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed Apr 10 18:34:14 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (dbf3f23e-d7f4-4f5a-8b70-153845caba81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a249471-8d8e-4add-8c31-93629cd0632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a249471-8d8e-4add-8c31-93629cd0632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422950504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3c6c4a-5ab2-426a-97cf-5222ac67a612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:14Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbea2b9-b0b0-416f-810e-3c4b6724018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bbea2b9-b0b0-416f-810e-3c4b6724018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c188b-ab7b-4b42-875b-a75191a2dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c188b-ab7b-4b42-875b-a75191a2dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3c6c4a-5ab2-426a-97cf-5222ac67a612', 'volume_name': 'volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df68703c-327e-44af-94ea-4153dd0b480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df68703c-327e-44af-94ea-4153dd0b480e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c5f02-94c1-4374-a60a-f85b58c50232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume ad3c6c4a-5ab2-426a-97cf-5222ac67a612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612', 'volume_size': 1} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-4d7a0789-bafb-41f4-b72f-aa0e0250b77a-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-4d7a0789-bafb-41f4-b72f-aa0e0250b77a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-4d7a0789-bafb-41f4-b72f-aa0e0250b77a" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-4d7a0789-bafb-41f4-b72f-aa0e0250b77a" acquired by "delete_volume" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[6229adcd-9d06-4785-bb2b-74d77bd2a835]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (2b2ad0e2-8925-4eef-941f-0be46be934d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d783d0-7e9c-42c4-8bbf-c088c0b9c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a Apr 10 18:34:14 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:14 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d783d0-7e9c-42c4-8bbf-c088c0b9c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503022464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4eaa9f-7838-4c6c-adaa-67c8ac574b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb0cb1a-1614-4cc5-b44b-68d06a73e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb0cb1a-1614-4cc5-b44b-68d06a73e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60417b59-16e9-4b17-b3a1-ac8b7d9080d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60417b59-16e9-4b17-b3a1-ac8b7d9080d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4eaa9f-7838-4c6c-adaa-67c8ac574b77', 'volume_name': 'volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccf1f7f-e1cc-420c-9345-27148229ac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dccf1f7f-e1cc-420c-9345-27148229ac0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94540e6a-b256-4f41-af08-809a490c4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume 2b4eaa9f-7838-4c6c-adaa-67c8ac574b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77', 'volume_size': 1} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c" returned: 0 in 0.580s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:14 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c is being set with open permissions: ugo+rw Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:14 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c Apr 10 18:34:14 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:14 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54.81a6f93e-38a0-4918-a435-638651f5feed" returned: 0 in 0.468s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-81a6f93e-38a0-4918-a435-638651f5feed" released by "_delete_snapshot" :: held 2.091s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" released by "delete_snapshot" :: held 2.103s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Created reservations ['356a50cc-f3dd-4d3a-9db2-5bbdbfd3331f', '4cf8421b-faa8-450a-a984-771a7a5b78ab', '13d3ddaf-200c-4879-ad25-5c7156998cf2', '88c451e2-c64b-44bd-a222-5f57687455b3'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:14 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Delete snapshot completed successfully. Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-0b0d6f2e-0bfc-4833-9a39-c5fb6ff44558 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-81a6f93e-38a0-4918-a435-638651f5feed-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (2769d55b-f023-4502-bfbf-8ae4fb14fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf297135-26a7-46c3-9ee9-3bfb04866823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf297135-26a7-46c3-9ee9-3bfb04866823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1629813818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd07c6c-4ae3-42d8-965f-ad620024f463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c46f471-4100-4f0d-aa07-d567558052db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c46f471-4100-4f0d-aa07-d567558052db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f32a022-c03d-4db1-88b1-44af9d91c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f32a022-c03d-4db1-88b1-44af9d91c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd07c6c-4ae3-42d8-965f-ad620024f463', 'volume_name': 'volume-6dd07c6c-4ae3-42d8-965f-ad620024f463', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e93e9c-4fa9-4200-a72c-5bf5cef22b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e93e9c-4fa9-4200-a72c-5bf5cef22b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c77877-9e3e-437d-81fa-b6d0255b1f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:14 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume 6dd07c6c-4ae3-42d8-965f-ad620024f463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd07c6c-4ae3-42d8-965f-ad620024f463', 'volume_size': 1} Apr 10 18:34:14 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (d17cdcc7-f93e-41a4-822a-079fc8fbb990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b500a3-238f-4f6b-b965-4ee739300496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b500a3-238f-4f6b-b965-4ee739300496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740700203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef97845-4a1d-45b6-9af7-7170694d0950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af279d94-9be3-4899-8751-368f4abc1ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af279d94-9be3-4899-8751-368f4abc1ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8fd90d-0f66-48c2-9119-5baf42101c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8fd90d-0f66-48c2-9119-5baf42101c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef97845-4a1d-45b6-9af7-7170694d0950', 'volume_name': 'volume-1ef97845-4a1d-45b6-9af7-7170694d0950', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d29906-3b5a-4f27-9058-36d11f73d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d29906-3b5a-4f27-9058-36d11f73d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6bed6b-b078-48ea-919b-b3d42183751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume 1ef97845-4a1d-45b6-9af7-7170694d0950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef97845-4a1d-45b6-9af7-7170694d0950', 'volume_size': 1} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:15 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c" returned: 0 in 0.506s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:15 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a" returned: 0 in 0.698s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:15 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info Apr 10 18:34:15 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:15 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a Apr 10 18:34:15 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (b05e7ed8-b7b8-49f4-b533-e8ab3c7ec4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76d9921-6a95-4bbe-aa48-f0c43f4a28d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76d9921-6a95-4bbe-aa48-f0c43f4a28d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230888091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cd9be6-4655-4b40-a437-fe371bbeff01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7a3380-a7e2-45f2-955f-02eee3db99c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7a3380-a7e2-45f2-955f-02eee3db99c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab97222d-87f7-4ca5-b374-d312f5f3e9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab97222d-87f7-4ca5-b374-d312f5f3e9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1cd9be6-4655-4b40-a437-fe371bbeff01', 'volume_name': 'volume-a1cd9be6-4655-4b40-a437-fe371bbeff01', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41314ae2-eb97-47ad-98e1-cec6fb9c9995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41314ae2-eb97-47ad-98e1-cec6fb9c9995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e433abe-d95d-49ac-8f97-14f796c022ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:15 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume a1cd9be6-4655-4b40-a437-fe371bbeff01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1cd9be6-4655-4b40-a437-fe371bbeff01', 'volume_size': 1} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:15 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info" returned: 0 in 0.439s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:15 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info is being set with open permissions: ugo+rw Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:15 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info Apr 10 18:34:15 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:15 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-4d7a0789-bafb-41f4-b72f-aa0e0250b77a" returned: 0 in 0.462s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-4d7a0789-bafb-41f4-b72f-aa0e0250b77a" released by "delete_volume" :: held 1.187s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['85a2aa84-f771-4d93-b236-60c65d71a8f0', '10ca1acc-f04a-411d-800d-bc8e2e1a7df5', '48c3c89a-a886-46a5-89f4-3b415c1c1835', 'd19fbf24-315f-415b-97e9-35d863298422'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:15 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:15 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a8fc7-a147-46bf-a844-71d29545a76e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:15 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:15 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:34:15 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:16 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.info" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422950504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3c6c4a-5ab2-426a-97cf-5222ac67a612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:14Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Creating volume ad3c6c4a-5ab2-426a-97cf-5222ac67a612 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:16 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:16 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 1073741824 Apr 10 18:34:16 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:16 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-495082ff-54cc-4cd8-80c4-030bf2e266c2 tempest-SnapshotDependencyTests-1206391521 None] Create snapshot completed successfully Apr 10 18:34:16 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:16 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleted volume successfully. Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-c0603c22-8f40-4be0-92af-4f511830e5aa tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-4d7a0789-bafb-41f4-b72f-aa0e0250b77a-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:16 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.503s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:16 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54 Apr 10 18:34:16 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:16 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 1073741824" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-d76b7dd3-1b81-4300-b049-a552d5e1886f-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-d76b7dd3-1b81-4300-b049-a552d5e1886f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-5834cad9-759c-473b-be40-eb10963561e9" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:16 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 Apr 10 18:34:16 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-5834cad9-759c-473b-be40-eb10963561e9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-d76b7dd3-1b81-4300-b049-a552d5e1886f" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-d76b7dd3-1b81-4300-b049-a552d5e1886f" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleting offline snapshot d76b7dd3-1b81-4300-b049-a552d5e1886f of volume 5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] snapshot_file for this snap is: volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[18908bd4-10f2-437a-a624-3d0d0e7cda50]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:16 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f Apr 10 18:34:16 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_service.periodic_task [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82020) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:16 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:16 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:16 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" returned: 0 in 0.471s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54" released by "delete_volume" :: held 1.013s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Created reservations ['092ecd01-d210-4c57-9aa7-c21b5ef98e2d', '94b4090f-3c21-4077-b8ff-79bdc500936f', '7923e175-8af2-465f-9b3f-d6779384a2ee', 'f57b610b-df1c-4b24-bb01-29839f23b49f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:16 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:16 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:16 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:17 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612" returned: 0 in 0.557s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.537s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1503022464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4eaa9f-7838-4c6c-adaa-67c8ac574b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Creating volume 2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:17 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:17 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 1073741824 Apr 10 18:34:17 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c5f02-94c1-4374-a60a-f85b58c50232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b12b8f-bb49-4173-9479-4a7b3d510a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:17 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 (ad3c6c4a-5ab2-426a-97cf-5222ac67a612): created successfully Apr 10 18:34:17 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b12b8f-bb49-4173-9479-4a7b3d510a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (dbf3f23e-d7f4-4f5a-8b70-153845caba81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f" returned: 0 in 0.642s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5834cad9-759c-473b-be40-eb10963561e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:17 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-00ae5812-deae-4fc1-a63e-2cc508afe59f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created volume successfully. Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0570a78f-c2ac-4aee-b5be-238e15d08d79]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Flow 'volume_create_manager' (1f48be1a-70f4-4b9c-bd05-4bd39c4be4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e30dd-b0bf-4921-be1d-c59e0a3c298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e30dd-b0bf-4921-be1d-c59e0a3c298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=775c12ca-439d-491d-9de2-3d9232544e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050235f606214597b0de9a8ed87513e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f92415b0-a447-421b-8055-1341fe12e61c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:17Z,use_quota=True,user_id='2ad128db3095497aa23c699a34f5d87b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb03fa13-bb2b-4d88-a57d-9d54a3500967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb03fa13-bb2b-4d88-a57d-9d54a3500967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588ab042-2f23-4ca4-93ec-412a61dd8f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588ab042-2f23-4ca4-93ec-412a61dd8f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '775c12ca-439d-491d-9de2-3d9232544e96', 'volume_name': 'volume-775c12ca-439d-491d-9de2-3d9232544e96', 'volume_size': 1, 'snapshot_id': 'f92415b0-a447-421b-8055-1341fe12e61c'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:17 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f73699-b6fe-403c-be03-f8d567c6382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:17 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f73699-b6fe-403c-be03-f8d567c6382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f8f224-642b-46ae-a383-9f99f92c72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:17 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Volume 775c12ca-439d-491d-9de2-3d9232544e96: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-775c12ca-439d-491d-9de2-3d9232544e96', 'volume_size': 1, 'snapshot_id': 'f92415b0-a447-421b-8055-1341fe12e61c'} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:17 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.574s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:17 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:17 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Deleted volume successfully. Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.766s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-114136ce-546f-48d7-84c1-6a5e2b7196ca None None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-edb20a2b-571c-4dad-8d15-b13dc3537f41 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-2cd3ea95-b7a4-4779-9bd6-0a18e53bcc54-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:17 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 1073741824" returned: 0 in 0.551s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:17 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 Apr 10 18:34:17 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:17 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9" returned: 0 in 0.546s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:17 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:17 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f Apr 10 18:34:17 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (39ef68f9-63d3-41ef-9dd6-4aebd03517de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7bd4f7-973a-42d2-b986-53a2b554dafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7bd4f7-973a-42d2-b986-53a2b554dafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094934541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b387ac73-e189-48b4-a21b-7fc21022132b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169082b0f4fa43a182ff698a31ed6e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:18Z,use_quota=True,user_id='dcdf83080d104445a7641029db27d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a1e246-5b77-4852-9709-706fe4abc3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a1e246-5b77-4852-9709-706fe4abc3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f67bc5-1675-449f-9267-c4e8f3d4ded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f67bc5-1675-449f-9267-c4e8f3d4ded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b387ac73-e189-48b4-a21b-7fc21022132b', 'volume_name': 'volume-b387ac73-e189-48b4-a21b-7fc21022132b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad04cef-55cb-424a-9051-f2dd4d2268dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad04cef-55cb-424a-9051-f2dd4d2268dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6deb4b-95e4-4e42-a103-cbf83114b09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:18 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Volume b387ac73-e189-48b4-a21b-7fc21022132b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b387ac73-e189-48b4-a21b-7fc21022132b', 'volume_size': 1} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:18 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77" returned: 0 in 0.494s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1629813818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd07c6c-4ae3-42d8-965f-ad620024f463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Creating volume 6dd07c6c-4ae3-42d8-965f-ad620024f463 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:18 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94540e6a-b256-4f41-af08-809a490c4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c20ba21-8346-4215-bbe8-0ead55e49c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:18 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 1073741824 Apr 10 18:34:18 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:18 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 (2b4eaa9f-7838-4c6c-adaa-67c8ac574b77): created successfully Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c20ba21-8346-4215-bbe8-0ead55e49c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (2b2ad0e2-8925-4eef-941f-0be46be934d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-c01eacbc-5a38-4cd2-83c9-6cc384e71596 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created volume successfully. Apr 10 18:34:18 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f" returned: 0 in 0.504s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:18 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f Apr 10 18:34:18 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:18 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 1073741824" returned: 0 in 0.527s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:18 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 Apr 10 18:34:18 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:18 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9.d76b7dd3-1b81-4300-b049-a552d5e1886f" returned: 0 in 0.480s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-d76b7dd3-1b81-4300-b049-a552d5e1886f" released by "_delete_snapshot" :: held 2.230s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-5834cad9-759c-473b-be40-eb10963561e9" released by "delete_snapshot" :: held 2.241s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['c58fbbad-ece0-4297-b992-1bfc0b61881c', '4ac1080f-db25-4b38-9372-1a16203a1807', 'be5858a2-655a-4bb9-bfcf-7e25121da9ff', 'e14bcb1a-6bd9-48af-a5f8-7af181d68d21'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:18 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Delete snapshot completed successfully. Apr 10 18:34:18 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-bf9c2668-5b79-4979-a038-1d03d8e87e77 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-d76b7dd3-1b81-4300-b049-a552d5e1886f-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:19 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463" returned: 0 in 0.427s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.098s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-740700203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef97845-4a1d-45b6-9af7-7170694d0950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Creating volume 1ef97845-4a1d-45b6-9af7-7170694d0950 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:19 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c77877-9e3e-437d-81fa-b6d0255b1f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd07c6c-4ae3-42d8-965f-ad620024f463', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57b054c-d2fe-4710-b09e-95a0f3f273b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:19 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 1073741824 Apr 10 18:34:19 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:19 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 (6dd07c6c-4ae3-42d8-965f-ad620024f463): created successfully Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57b054c-d2fe-4710-b09e-95a0f3f273b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (2769d55b-f023-4502-bfbf-8ae4fb14fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:19 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-390670fe-a140-46fe-adad-9a3c29c0f0d3 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created volume successfully. Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-5834cad9-759c-473b-be40-eb10963561e9-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-5834cad9-759c-473b-be40-eb10963561e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "cinder-quobyte-5834cad9-759c-473b-be40-eb10963561e9" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-5834cad9-759c-473b-be40-eb10963561e9" acquired by "delete_volume" :: waited 0.006s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:19 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 1073741824" returned: 0 in 0.529s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c128a-5b68-43d1-b5ce-d07a33d68587]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:19 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:19 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 Apr 10 18:34:19 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:19 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 Apr 10 18:34:19 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:20 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.959s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230888091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1cd9be6-4655-4b40-a437-fe371bbeff01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='795b95802adc4fd4ab28689a4ba6c915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:15Z,use_quota=True,user_id='28ad0f6547be4e0492b9b7c40108f258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Creating volume a1cd9be6-4655-4b40-a437-fe371bbeff01 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:20 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6bed6b-b078-48ea-919b-b3d42183751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef97845-4a1d-45b6-9af7-7170694d0950', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:20 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 1073741824 Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ac02c-628e-450c-a653-63cc8e21ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:20 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:20 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume volume-1ef97845-4a1d-45b6-9af7-7170694d0950 (1ef97845-4a1d-45b6-9af7-7170694d0950): created successfully Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ac02c-628e-450c-a653-63cc8e21ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (d17cdcc7-f93e-41a4-822a-079fc8fbb990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:20 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9" returned: 0 in 0.532s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:20 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-4978537b-6c3e-421f-b9c1-8d3c79619405 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created volume successfully. Apr 10 18:34:20 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9 Apr 10 18:34:20 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:20 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-5834cad9-759c-473b-be40-eb10963561e9" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-quobyte-5834cad9-759c-473b-be40-eb10963561e9" released by "delete_volume" :: held 1.032s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Created reservations ['b0e2deb2-45d8-4077-b759-09a522a26fd4', 'e36a6662-f1db-4723-befd-03309749c6df', 'c5ecf817-c35d-43a6-b8af-9713769d519f', '7d86b01b-e238-4d68-98f0-1ecc37cdcd05'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:20 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 1073741824" returned: 0 in 0.557s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:20 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 Apr 10 18:34:20 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:20 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:20 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:20 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:21 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01" returned: 0 in 0.412s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.796s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-quobyte-f92415b0-a447-421b-8055-1341fe12e61c-775c12ca-439d-491d-9de2-3d9232544e96" by "_create_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e433abe-d95d-49ac-8f97-14f796c022ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1cd9be6-4655-4b40-a437-fe371bbeff01', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6ed749-d554-4993-bfd8-92ada752b824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:21 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Volume volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 (a1cd9be6-4655-4b40-a437-fe371bbeff01): created successfully Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6ed749-d554-4993-bfd8-92ada752b824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:21 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Flow 'volume_create_manager' (b05e7ed8-b7b8-49f4-b533-e8ab3c7ec4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-f92415b0-a447-421b-8055-1341fe12e61c-775c12ca-439d-491d-9de2-3d9232544e96" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Creating volume 775c12ca-439d-491d-9de2-3d9232544e96 from snapshot f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-quobyte-775c12ca-439d-491d-9de2-3d9232544e96" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.438s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-6cc3eb23-926c-4496-93da-d748fc7bb893 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created volume successfully. Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-775c12ca-439d-491d-9de2-3d9232544e96" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] snapshot: f92415b0-a447-421b-8055-1341fe12e61c, volume: 775c12ca-439d-491d-9de2-3d9232544e96, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:34:21 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Deleted volume successfully. Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbc999c-801a-4492-bbc1-98f52908e1af]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-4d967593-e4aa-47a8-8131-ae069c347ec5 tempest-CreateVolumesFromSnapshotTest-523271683 None] Lock "cinder-5834cad9-759c-473b-be40-eb10963561e9-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:21 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c Apr 10 18:34:21 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-a1cd9be6-4655-4b40-a437-fe371bbeff01-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-a1cd9be6-4655-4b40-a437-fe371bbeff01-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:21 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c" returned: 0 in 0.486s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[55062269-b8a5-4fba-b03a-860b1498b01a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-quobyte-a1cd9be6-4655-4b40-a437-fe371bbeff01" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-a1cd9be6-4655-4b40-a437-fe371bbeff01" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e77fe2-b9b5-42a8-8271-27e92ba2f17a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:21 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:21 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:21 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:21 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 Apr 10 18:34:21 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:22 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.536s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:22 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 Apr 10 18:34:22 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:22 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01" returned: 0 in 0.531s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:22 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01 Apr 10 18:34:22 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:22 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a1cd9be6-4655-4b40-a437-fe371bbeff01" returned: 0 in 0.459s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-a1cd9be6-4655-4b40-a437-fe371bbeff01" released by "delete_volume" :: held 1.011s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:22 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created reservations ['6034df83-c20d-4d67-bbb0-c11e98ef8c8f', 'acd9ad72-7235-4f2a-8b5f-97793f395bb9', 'f06aaf55-1bc6-43c2-89f9-e496787976b8', '5c63fc7c-b9a6-413c-a7c5-e47582edbeb9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:23 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:23 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:23 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.891s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:23 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Deleted volume successfully. Apr 10 18:34:23 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-16f5300a-bc72-4301-8e8b-028ce190ab4c tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-a1cd9be6-4655-4b40-a437-fe371bbeff01-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-1ef97845-4a1d-45b6-9af7-7170694d0950-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-1ef97845-4a1d-45b6-9af7-7170694d0950-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-quobyte-1ef97845-4a1d-45b6-9af7-7170694d0950" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-1ef97845-4a1d-45b6-9af7-7170694d0950" acquired by "delete_volume" :: waited 0.042s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8114ac-0b05-477d-a9ab-b1c6a253622d]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:24 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 Apr 10 18:34:24 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:24 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96" returned: 0 in 2.343s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[93beeadc-64b6-4dc0-aa50-bdf93fc9307c]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:24 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:24 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Flow 'volume_create_manager' (cbc3a528-792d-4726-934e-83022735768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c645fe-5fa5-48e9-8d8f-20d8934fbaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c645fe-5fa5-48e9-8d8f-20d8934fbaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ad8b18-a6c6-4d24-959c-668f96aa3e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdb74abde943a6a3722fda1ffb89af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:25Z,use_quota=True,user_id='9a22c3592b5449e4bd7e8e8a391097dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b89020-d091-450b-b8b8-1b2dcef48109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b89020-d091-450b-b8b8-1b2dcef48109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26737b0-2b36-4fb2-a3b7-106a0b9975ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f26737b0-2b36-4fb2-a3b7-106a0b9975ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ad8b18-a6c6-4d24-959c-668f96aa3e51', 'volume_name': 'volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a7aa25-d913-48c9-8bbe-616191bc5079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a7aa25-d913-48c9-8bbe-616191bc5079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fe492a-14be-4cbc-8eb8-7a4e4206e3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:24 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Volume 66ad8b18-a6c6-4d24-959c-668f96aa3e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51', 'volume_size': 1} Apr 10 18:34:24 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:25 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950" returned: 0 in 0.719s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:25 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950 Apr 10 18:34:25 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:25 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.605s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:34:25 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Converted 1024.00 MB image at 436.85 MB/s Apr 10 18:34:25 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 is being set with open permissions: ugo+rw Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:25 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 Apr 10 18:34:25 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:25 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-1ef97845-4a1d-45b6-9af7-7170694d0950" returned: 0 in 0.413s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-1ef97845-4a1d-45b6-9af7-7170694d0950" released by "delete_volume" :: held 1.186s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created reservations ['bc361727-8859-4ef0-918a-1f1f570416ab', '154ba7ea-635d-4523-b554-03d9ae3acaef', 'e84b9e98-b754-4934-9ef3-6369b4291436', 'e0b94cf4-6ecc-4004-b908-99e9cc5bf39a'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:25 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:25 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:25 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96" returned: 0 in 0.425s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-775c12ca-439d-491d-9de2-3d9232544e96" released by "_copy_volume_from_snapshot" :: held 4.460s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-f92415b0-a447-421b-8055-1341fe12e61c-775c12ca-439d-491d-9de2-3d9232544e96" released by "_create_volume_from_snapshot" :: held 4.487s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.529s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.563s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094934541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b387ac73-e189-48b4-a21b-7fc21022132b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169082b0f4fa43a182ff698a31ed6e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:18Z,use_quota=True,user_id='dcdf83080d104445a7641029db27d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Creating volume b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:25 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f8f224-642b-46ae-a383-9f99f92c72f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-775c12ca-439d-491d-9de2-3d9232544e96', 'volume_size': 1, 'snapshot_id': 'f92415b0-a447-421b-8055-1341fe12e61c'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550ebfd0-b9e6-4735-9556-3f03b24a8b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:25 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b 1073741824 Apr 10 18:34:25 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:25 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Volume volume-775c12ca-439d-491d-9de2-3d9232544e96 (775c12ca-439d-491d-9de2-3d9232544e96): created successfully Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550ebfd0-b9e6-4735-9556-3f03b24a8b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:25 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Flow 'volume_create_manager' (1f48be1a-70f4-4b9c-bd05-4bd39c4be4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:25 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b4f717dd-2d8f-4afe-8c84-18119220de41 tempest-SnapshotDependencyTests-1206391521 None] Created volume successfully. Apr 10 18:34:26 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.418s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:26 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Deleted volume successfully. Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-18e254fe-7cd1-4c83-b706-69430831187b tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-1ef97845-4a1d-45b6-9af7-7170694d0950-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:26 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b 1073741824" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:26 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:26 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-6dd07c6c-4ae3-42d8-965f-ad620024f463-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-6dd07c6c-4ae3-42d8-965f-ad620024f463-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-quobyte-6dd07c6c-4ae3-42d8-965f-ad620024f463" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-6dd07c6c-4ae3-42d8-965f-ad620024f463" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7dc89-e9e3-4475-83fa-92b112e2594f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:26 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 Apr 10 18:34:26 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:26 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.414s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ad8b18-a6c6-4d24-959c-668f96aa3e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdb74abde943a6a3722fda1ffb89af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:25Z,use_quota=True,user_id='9a22c3592b5449e4bd7e8e8a391097dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Creating volume 66ad8b18-a6c6-4d24-959c-668f96aa3e51 {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:26 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b6deb4b-95e4-4e42-a103-cbf83114b09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b387ac73-e189-48b4-a21b-7fc21022132b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:26 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 1073741824 Apr 10 18:34:26 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6e8e50-3fb4-4ae4-bcad-c13c72848fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:26 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Volume volume-b387ac73-e189-48b4-a21b-7fc21022132b (b387ac73-e189-48b4-a21b-7fc21022132b): created successfully Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6e8e50-3fb4-4ae4-bcad-c13c72848fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (39ef68f9-63d3-41ef-9dd6-4aebd03517de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:26 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e6677315-df1f-4bdd-8921-649987dbc830 tempest-VolumeDependencyTests-1721715164 None] Created volume successfully. Apr 10 18:34:26 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-f92415b0-a447-421b-8055-1341fe12e61c-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-f92415b0-a447-421b-8055-1341fe12e61c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-quobyte-7392d9ed-e2b9-4653-827f-1361dd78e3aa" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:27 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-7392d9ed-e2b9-4653-827f-1361dd78e3aa" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-quobyte-f92415b0-a447-421b-8055-1341fe12e61c" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463" returned: 0 in 0.557s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-f92415b0-a447-421b-8055-1341fe12e61c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Deleting offline snapshot f92415b0-a447-421b-8055-1341fe12e61c of volume 7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:34:27 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463 Apr 10 18:34:27 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] snapshot_file for this snap is: volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bad178-2d50-4031-860f-da3b13592381]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:27 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c Apr 10 18:34:27 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:27 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 1073741824" returned: 0 in 0.492s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:27 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 Apr 10 18:34:27 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:27 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-6dd07c6c-4ae3-42d8-965f-ad620024f463" returned: 0 in 0.447s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-6dd07c6c-4ae3-42d8-965f-ad620024f463" released by "delete_volume" :: held 1.029s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created reservations ['a8e31d76-5829-462b-a7e5-c059bcc9ecd2', '9920fcd6-efe4-4a7e-84a6-fc691a1135ba', '7da7a09a-d32e-424e-902b-af73e563d025', '14090cca-d250-4a91-899b-3c6a3e2d0687'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:27 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c" returned: 0 in 0.523s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:27 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:27 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e19eb62-6e7e-4aba-817f-04206ab91019]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:27 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:27 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:27 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51" returned: 0 in 0.433s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fe492a-14be-4cbc-8eb8-7a4e4206e3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494d7de7-5ce5-4f20-928c-ea9eddae8176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:27 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Volume volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 (66ad8b18-a6c6-4d24-959c-668f96aa3e51): created successfully Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494d7de7-5ce5-4f20-928c-ea9eddae8176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:27 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Flow 'volume_create_manager' (cbc3a528-792d-4726-934e-83022735768f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:27 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-2914c69a-e66b-4f74-a06b-1604edb28b03 tempest-CinderUnicodeTest-421849959 None] Created volume successfully. Apr 10 18:34:28 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.517s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:28 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Deleted volume successfully. Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-1d2d0825-a4ef-4a98-ba05-5ea2f4ce349f tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-6dd07c6c-4ae3-42d8-965f-ad620024f463-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:28 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.516s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:28 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c Apr 10 18:34:28 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (864d5933-1fc5-42a8-b7a0-8385524931d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1807a5-5383-4354-be8e-ab96a36361c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1807a5-5383-4354-be8e-ab96a36361c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2011828493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab77c26a-a36d-4750-994a-1b0ce834f686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='169082b0f4fa43a182ff698a31ed6e5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b387ac73-e189-48b4-a21b-7fc21022132b,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:28Z,use_quota=True,user_id='dcdf83080d104445a7641029db27d4cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb71a32c-4048-421e-80e7-2b83166a55f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb71a32c-4048-421e-80e7-2b83166a55f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f5063a-f9b3-4069-bd41-c839392a35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f5063a-f9b3-4069-bd41-c839392a35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ab77c26a-a36d-4750-994a-1b0ce834f686', 'volume_name': 'volume-ab77c26a-a36d-4750-994a-1b0ce834f686', 'volume_size': 1, 'source_volid': 'b387ac73-e189-48b4-a21b-7fc21022132b', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d358fb-8ef8-4fc4-bd98-61fe3ab9dd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d358fb-8ef8-4fc4-bd98-61fe3ab9dd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38180e72-42a2-40da-9627-a0e0fe6329e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Volume ab77c26a-a36d-4750-994a-1b0ce834f686: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ab77c26a-a36d-4750-994a-1b0ce834f686', 'volume_size': 1, 'source_volid': 'b387ac73-e189-48b4-a21b-7fc21022132b', 'source_volstatus': 'available'} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:28 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Cloning volume b387ac73-e189-48b4-a21b-7fc21022132b to volume ab77c26a-a36d-4750-994a-1b0ce834f686 Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.flows.manager.create_volume [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82020) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Flow 'volume_create_manager' (b21706a7-ab7c-4feb-a6c4-edf7a5735831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6c35bd-4c13-4381-aef8-111831d4f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6c35bd-4c13-4381-aef8-111831d4f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1390564430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fd0a56-94df-4778-81dd-79d64437b84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdb74abde943a6a3722fda1ffb89af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:28Z,use_quota=True,user_id='9a22c3592b5449e4bd7e8e8a391097dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb35a8a5-98e0-4d6e-97e8-2b2719046fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb35a8a5-98e0-4d6e-97e8-2b2719046fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac49565-0097-4ddb-8994-173710ade384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac49565-0097-4ddb-8994-173710ade384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fd0a56-94df-4778-81dd-79d64437b84b', 'volume_name': 'volume-a5fd0a56-94df-4778-81dd-79d64437b84b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df89e94-01e6-4604-a0b1-d6ab5e63161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df89e94-01e6-4604-a0b1-d6ab5e63161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d821d-6c09-46a6-b9f0-34f4b21ef9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:28 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Volume a5fd0a56-94df-4778-81dd-79d64437b84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fd0a56-94df-4778-81dd-79d64437b84b', 'volume_size': 1} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Creating offline snapshot c2a70612-af9d-48e9-b164-2b842591d8a6 of volume b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb0138-f88d-487e-b076-41af5b7c966a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:28 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:28 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:28 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c" returned: 0 in 0.491s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:28 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c Apr 10 18:34:28 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-quobyte-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[f943fb66-5fda-4369-9190-1d346a7025fa]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:28 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 Apr 10 18:34:28 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:28 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.499s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:28 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:28 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 1G Apr 10 18:34:28 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa.f92415b0-a447-421b-8055-1341fe12e61c" returned: 0 in 0.407s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-f92415b0-a447-421b-8055-1341fe12e61c" released by "_delete_snapshot" :: held 1.989s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-7392d9ed-e2b9-4653-827f-1361dd78e3aa" released by "delete_snapshot" :: held 2.014s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Created reservations ['065826eb-384f-4011-82f0-3e3933652f39', '5a5824e2-53de-45bc-a737-3751cf7dca34', 'bce69272-9de8-4c67-ac08-6352d4299c7b', '537d8d96-6511-4437-b8ac-7c0c4bdaae8b'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:29 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Delete snapshot completed successfully. Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-187e2f53-f599-422b-a0b9-8ac73080e506 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-f92415b0-a447-421b-8055-1341fe12e61c-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-7392d9ed-e2b9-4653-827f-1361dd78e3aa-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:29 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77" returned: 0 in 0.495s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-7392d9ed-e2b9-4653-827f-1361dd78e3aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:29 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77 Apr 10 18:34:29 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-quobyte-7392d9ed-e2b9-4653-827f-1361dd78e3aa" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-7392d9ed-e2b9-4653-827f-1361dd78e3aa" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c32c5-a1e6-4b99-87f0-0bc6a2dc836b]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:29 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 1G" returned: 0 in 0.541s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b387ac73-e189-48b4-a21b-7fc21022132b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b387ac73-e189-48b4-a21b-7fc21022132b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 Apr 10 18:34:29 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77" returned: 0 in 0.452s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77" released by "delete_volume" :: held 0.967s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created reservations ['32a2388e-c3f4-4651-b4da-4d2797430452', '17ab7814-12d3-4109-9d6a-64d2e1fa2885', '8cf4e84d-9310-4f51-ad2a-6dd7b1d0cf37', '00d244ba-97b4-4f6f-945c-6ee70799c7c8'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:29 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-ad3c6c4a-5ab2-426a-97cf-5222ac67a612-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-ad3c6c4a-5ab2-426a-97cf-5222ac67a612-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-quobyte-ad3c6c4a-5ab2-426a-97cf-5222ac67a612" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-ad3c6c4a-5ab2-426a-97cf-5222ac67a612" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:29 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.560s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdac326-ede6-40b4-ab36-a9e8db133510]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa Apr 10 18:34:29 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 Apr 10 18:34:29 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:29 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b387ac73-e189-48b4-a21b-7fc21022132b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6" returned: 0 in 0.485s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:29 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 is being set with open permissions: ugo+rw Apr 10 18:34:29 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:29 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 Apr 10 18:34:29 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:30 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.449s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Deleted volume successfully. Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-e2c26d16-6bbb-403c-b2a2-a3ca33f6c7fe tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-2b4eaa9f-7838-4c6c-adaa-67c8ac574b77-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:30 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-7392d9ed-e2b9-4653-827f-1361dd78e3aa" returned: 0 in 0.460s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-7392d9ed-e2b9-4653-827f-1361dd78e3aa" released by "delete_volume" :: held 1.047s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:30 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Created reservations ['68ee5175-9d75-40ae-9bb0-d12c93f1ca27', '76f3b4df-2c3c-45c3-a38a-a3d3658dd66f', '4d1e8871-3313-4e63-93a3-0e8c6c5991d3', '20407e01-e1e4-475f-becb-ac81f2efc0df'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6" returned: 0 in 0.426s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612" returned: 0 in 0.522s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:30 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612 Apr 10 18:34:30 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:30 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info Apr 10 18:34:30 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:30 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:30 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:30 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info" returned: 0 in 0.398s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info is being set with open permissions: ugo+rw Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:30 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ad3c6c4a-5ab2-426a-97cf-5222ac67a612" returned: 0 in 0.422s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-ad3c6c4a-5ab2-426a-97cf-5222ac67a612" released by "delete_volume" :: held 0.986s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:30 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info Apr 10 18:34:30 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:30 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created reservations ['c40fccf9-ab9d-43bf-a9dc-2298c369afdd', 'b33ad857-6bbd-42a9-92ce-ce73d760556f', '08bd163e-dc2c-45b1-8706-ae40f7db0216', 'db34e8f1-b17b-40ae-b21d-31cfa8506e94'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.423s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:30 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Deleted volume successfully. Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-499ca4e0-a481-4d98-9e4b-39370d1ad2a3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-7392d9ed-e2b9-4653-827f-1361dd78e3aa-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:30 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:30 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:30 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:31 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.info" returned: 0 in 0.439s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-ab77c26a-a36d-4750-994a-1b0ce834f686" by "_copy_volume_from_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-ab77c26a-a36d-4750-994a-1b0ce834f686" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] snapshot: c2a70612-af9d-48e9-b164-2b842591d8a6, volume: ab77c26a-a36d-4750-994a-1b0ce834f686, {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7c18f-f6be-4c16-806d-fb38e28412f8]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:31 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.421s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:31 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 Apr 10 18:34:31 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:31 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Deleted volume successfully. Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b75d3ece-c6d8-4ab4-8b08-67376d722406 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-ad3c6c4a-5ab2-426a-97cf-5222ac67a612-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-775c12ca-439d-491d-9de2-3d9232544e96-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-775c12ca-439d-491d-9de2-3d9232544e96-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "cinder-quobyte-775c12ca-439d-491d-9de2-3d9232544e96" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-775c12ca-439d-491d-9de2-3d9232544e96" acquired by "delete_volume" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2384d4-72e6-47e4-94e1-2620ada10514]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:31 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 Apr 10 18:34:31 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:31 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b387ac73-e189-48b4-a21b-7fc21022132b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Creating direct copy from snapshot {{(pid=82020) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0c3341-0478-4f60-85ac-19d9a9dd577f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:31 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:31 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:31 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:31 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96 Apr 10 18:34:31 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "cinder-quobyte-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcb25d8-798f-4a86-af6e-257ec198d989]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:31 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:32 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f Apr 10 18:34:32 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:32 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.493s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG cinder.utils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Path /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 not found in is_blk_device check {{(pid=82020) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:32 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 Apr 10 18:34:32 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:32 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-775c12ca-439d-491d-9de2-3d9232544e96" returned: 0 in 0.403s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-quobyte-775c12ca-439d-491d-9de2-3d9232544e96" released by "delete_volume" :: held 0.928s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Created reservations ['7a98e559-ee8f-4e76-9512-c4bbbe372545', 'd2df4b3c-1eb3-41c9-aab3-f241df055525', '35ccc18a-2b98-4c77-b6b4-38b3c9db79b2', 'd548df20-ee6d-43d5-a7b5-8750146cf031'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:32 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:32 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:32 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f" returned: 0 in 0.512s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:32 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:32 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f Apr 10 18:34:32 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:33 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f" returned: 0 in 1.108s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:33 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 1.235s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-quobyte-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f" released by "delete_volume" :: held 1.664s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:33 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Deleted volume successfully. Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-8114d673-c48c-4610-8296-a5598c956df3 tempest-SnapshotDependencyTests-1206391521 None] Lock "cinder-775c12ca-439d-491d-9de2-3d9232544e96-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Created reservations ['cd850606-aec5-44da-beb3-39dce8557a10', '5b754738-c487-448e-8793-c97e30cb7bce', '5bb51bd9-2bd3-438b-9cee-4ac6e2626983', '77c24c7d-8e30-4ada-b8e9-c995f29fa1be'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:33 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:33 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:33 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:34 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686" returned: 0 in 2.277s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:34 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0103db-c160-4ed1-92aa-dd8afcf08e9e]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:34 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:34 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:34 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:34 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.809s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:34 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:34 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Deleted volume successfully. Apr 10 18:34:34 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4a561b3-80c7-4bbd-9166-e9505f4a3cf5 tempest-CreateVolumesFromSourceVolumeTest-1784785728 None] Lock "cinder-bf33cde9-7ac2-4ed0-87f7-2dab186d8d1f-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:35 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.817s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG cinder.image.image_utils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Image conversion details: src /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 {{(pid=82020) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 18:34:35 devstack cinder-volume[82020]: INFO cinder.image.image_utils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Converted 1024.00 MB image at 449.53 MB/s Apr 10 18:34:35 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 is being set with open permissions: ugo+rw Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:35 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 Apr 10 18:34:35 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:35 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686" returned: 0 in 0.487s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-ab77c26a-a36d-4750-994a-1b0ce834f686" released by "_copy_volume_from_snapshot" :: held 4.633s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-c2a70612-af9d-48e9-b164-2b842591d8a6" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-c2a70612-af9d-48e9-b164-2b842591d8a6" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Deleting offline snapshot c2a70612-af9d-48e9-b164-2b842591d8a6 of volume b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] snapshot_file for this snap is: volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b495fd-1ecc-4405-ad47-4987f5ffb7eb]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:35 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:35 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 Apr 10 18:34:35 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:36 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6" returned: 0 in 0.496s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:36 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b387ac73-e189-48b4-a21b-7fc21022132b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:36 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1b5cdf-c680-4461-ab7b-0c8a010c46d7]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:36 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:36 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:36 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.539s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:36 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:36 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 Apr 10 18:34:36 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:37 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6" returned: 0 in 0.472s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:37 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6 Apr 10 18:34:37 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:37 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b.c2a70612-af9d-48e9-b164-2b842591d8a6" returned: 0 in 0.446s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-c2a70612-af9d-48e9-b164-2b842591d8a6" released by "_delete_snapshot" :: held 2.009s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.622s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.555s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T16:34:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1390564430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fd0a56-94df-4778-81dd-79d64437b84b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ecdb74abde943a6a3722fda1ffb89af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T16:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T16:34:28Z,use_quota=True,user_id='9a22c3592b5449e4bd7e8e8a391097dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f6aa2f9-6692-4346-90f0-54d82f3d3738),volume_type_id=8f6aa2f9-6692-4346-90f0-54d82f3d3738)}" {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Creating volume a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Selected osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 as target Quobyte volume. {{(pid=82020) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 18:34:37 devstack cinder-volume[82020]: INFO cinder.volume.drivers.remotefs [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] casted to osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514 Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b 1073741824 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38180e72-42a2-40da-9627-a0e0fe6329e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab77c26a-a36d-4750-994a-1b0ce834f686', 'volume_size': 1, 'source_volid': 'b387ac73-e189-48b4-a21b-7fc21022132b', 'source_volstatus': 'available'}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:37 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b 1073741824 Apr 10 18:34:37 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270f5c8b-5ae7-4528-afe0-39b58d5b5297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:37 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Volume volume-ab77c26a-a36d-4750-994a-1b0ce834f686 (ab77c26a-a36d-4750-994a-1b0ce834f686): created successfully Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270f5c8b-5ae7-4528-afe0-39b58d5b5297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:37 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Flow 'volume_create_manager' (864d5933-1fc5-42a8-b7a0-8385524931d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:37 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b1cd51dc-5cd5-4fa5-ad8f-3598f67cabd1 tempest-VolumeDependencyTests-1721715164 None] Created volume successfully. Apr 10 18:34:38 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b 1073741824" returned: 0 in 0.630s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:38 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b Apr 10 18:34:38 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-b387ac73-e189-48b4-a21b-7fc21022132b-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-b387ac73-e189-48b4-a21b-7fc21022132b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-b387ac73-e189-48b4-a21b-7fc21022132b" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-b387ac73-e189-48b4-a21b-7fc21022132b" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e74228-070c-4ba9-bb74-1f756cb80a9a]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:38 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:39 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:39 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:39 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b" returned: 0 in 0.476s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'} {{(pid=82020) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502d821d-6c09-46a6-b9f0-34f4b21ef9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fd0a56-94df-4778-81dd-79d64437b84b', 'volume_size': 1}' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c87cc61-f04c-48f0-9b25-c70d4ce0f83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 18:34:39 devstack cinder-volume[82020]: INFO cinder.volume.flows.manager.create_volume [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Volume volume-a5fd0a56-94df-4778-81dd-79d64437b84b (a5fd0a56-94df-4778-81dd-79d64437b84b): created successfully Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c87cc61-f04c-48f0-9b25-c70d4ce0f83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82020) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Flow 'volume_create_manager' (b21706a7-ab7c-4feb-a6c4-edf7a5735831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82020) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 18:34:39 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-b501812d-92a1-4b1d-8073-11dbaa3d8ed5 tempest-CinderUnicodeTest-421849959 None] Created volume successfully. Apr 10 18:34:39 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.509s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:39 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b Apr 10 18:34:39 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:39 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-b387ac73-e189-48b4-a21b-7fc21022132b" returned: 0 in 0.450s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-b387ac73-e189-48b4-a21b-7fc21022132b" released by "delete_volume" :: held 0.999s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Created reservations ['2d18409f-e684-4029-80e1-8c25ba9d98e2', '192cc856-af61-4089-8858-3a08f8a60a29', '8304055e-d347-4626-928e-bb933bbcad2b', 'b6e53baf-7c0c-4c43-b5cc-cf2aef210e92'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:39 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:40 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:40 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Creating offline snapshot c66dbbca-c4cf-44e8-839f-64630cf634e5 of volume a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b2401d-b4be-43f0-a8a9-c4b9ef2c7dcd]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:40 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b Apr 10 18:34:40 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:40 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.480s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:40 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Deleted volume successfully. Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-aed1a2e2-e24a-4d98-b65f-ee5029255366 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-b387ac73-e189-48b4-a21b-7fc21022132b-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:40 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b" returned: 0 in 0.474s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:40 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 1G {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:40 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 1G Apr 10 18:34:40 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-ab77c26a-a36d-4750-994a-1b0ce834f686-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-ab77c26a-a36d-4750-994a-1b0ce834f686-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-ab77c26a-a36d-4750-994a-1b0ce834f686" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-ab77c26a-a36d-4750-994a-1b0ce834f686" acquired by "delete_volume" :: waited 0.008s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[98783e09-e837-43a0-8a38-f775ac37a679]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:41 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 Apr 10 18:34:41 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:41 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 1G" returned: 0 in 0.481s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5fd0a56-94df-4778-81dd-79d64437b84b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:41 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5fd0a56-94df-4778-81dd-79d64437b84b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 Apr 10 18:34:41 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:41 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686" returned: 0 in 0.475s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:41 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686 Apr 10 18:34:41 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:41 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5fd0a56-94df-4778-81dd-79d64437b84b -F qcow2 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5" returned: 0 in 0.435s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:41 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 is being set with open permissions: ugo+rw Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:41 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 Apr 10 18:34:41 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:41 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-ab77c26a-a36d-4750-994a-1b0ce834f686" returned: 0 in 0.402s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-ab77c26a-a36d-4750-994a-1b0ce834f686" released by "delete_volume" :: held 0.898s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:41 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Created reservations ['8b51a5b9-1fd3-4e84-b783-750fbffa9547', 'd69c020b-b8b9-4867-8d29-9ae9a92cd8b7', '7684164c-eab5-48d9-9cac-08e124505820', '05b6ae2c-e018-4627-bf87-2c0de70a509c'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:42 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5" returned: 0 in 0.408s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:42 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info Apr 10 18:34:42 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:42 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:42 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "cinder-quobyte-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" acquired by "delete_volume" :: waited 0.010s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e16278-59bd-4064-963f-8805e4d0e5fe]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:42 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e Apr 10 18:34:42 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:42 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info" returned: 0 in 0.452s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:42 devstack cinder-volume[82020]: WARNING cinder.volume.drivers.remotefs [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info is being set with open permissions: ugo+rw Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:42 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info Apr 10 18:34:42 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:42 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.457s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:42 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Deleted volume successfully. Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d2be9d78-0ea9-4ea5-8176-d20d597bc5ec tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-ab77c26a-a36d-4750-994a-1b0ce834f686-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:42 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" returned: 0 in 0.478s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:42 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e Apr 10 18:34:42 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:42 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.info" returned: 0 in 0.436s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:42 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.751s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:42 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-dbabe8c6-d965-4bdd-b3b4-d21fe7e71ac2 tempest-CinderUnicodeTest-421849959 None] Create snapshot completed successfully Apr 10 18:34:43 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" returned: 0 in 0.430s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-quobyte-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e" released by "delete_volume" :: held 0.934s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Created reservations ['5a6fa109-b064-404d-aa1f-b31c03b1d18d', 'e001324c-35d9-4ca2-8b2b-0e0f703ae5b2', '7d236c43-d748-410f-899d-762afcc73e6c', 'a03de42e-c49d-42b9-a3bd-ace56cc41837'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:43 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:43 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-c66dbbca-c4cf-44e8-839f-64630cf634e5-delete_snapshot" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Lock "cinder-c66dbbca-c4cf-44e8-839f-64630cf634e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-quobyte-a5fd0a56-94df-4778-81dd-79d64437b84b" by "delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-a5fd0a56-94df-4778-81dd-79d64437b84b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-quobyte-c66dbbca-c4cf-44e8-839f-64630cf634e5" by "_delete_snapshot" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-c66dbbca-c4cf-44e8-839f-64630cf634e5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Deleting offline snapshot c66dbbca-c4cf-44e8-839f-64630cf634e5 of volume a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] snapshot_file for this snap is: volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 {{(pid=82020) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914ed1c-9065-41fc-b363-bb3e72215b3f]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:43 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 Apr 10 18:34:43 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:43 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.510s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:43 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Deleted volume successfully. Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-30d05256-ba8c-4f6f-a3f9-511ce65de3e2 tempest-VolumeDependencyTests-1721715164 None] Lock "cinder-85b7c2ba-77f0-4f0d-b3e3-b5c6fd79497e-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:43 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5" returned: 0 in 0.530s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.remotefs [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5fd0a56-94df-4778-81dd-79d64437b84b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82020) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[93950726-182a-43a9-9f94-6349d53239b5]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:43 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:44 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b Apr 10 18:34:44 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:44 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b" returned: 0 in 0.536s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:44 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 Apr 10 18:34:44 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:44 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5" returned: 0 in 0.441s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:44 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:44 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5 Apr 10 18:34:44 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:45 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:45 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b.c66dbbca-c4cf-44e8-839f-64630cf634e5" returned: 0 in 0.414s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-c66dbbca-c4cf-44e8-839f-64630cf634e5" released by "_delete_snapshot" :: held 1.972s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-a5fd0a56-94df-4778-81dd-79d64437b84b" released by "delete_snapshot" :: held 1.983s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:45 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Created reservations ['fd5874e0-76ff-4596-9e22-3a96ef0fd72e', 'b75381f9-e908-4d35-896c-12b2e3418cf3', 'cb62e7e0-1213-48e7-a684-df785170d593', '144edeea-9c08-430d-936a-837962f30fd9'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:45 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Delete snapshot completed successfully. Apr 10 18:34:45 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-3c0d9380-320c-4ea0-b746-a08b65b0ddde tempest-CinderUnicodeTest-421849959 None] Lock "cinder-c66dbbca-c4cf-44e8-839f-64630cf634e5-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-a5fd0a56-94df-4778-81dd-79d64437b84b-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-a5fd0a56-94df-4778-81dd-79d64437b84b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-quobyte-a5fd0a56-94df-4778-81dd-79d64437b84b" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:46 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-a5fd0a56-94df-4778-81dd-79d64437b84b" acquired by "delete_volume" :: waited 0.012s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:46 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73be887-bb70-45e8-b3c9-68c1c698f7e4]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:46 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:46 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b Apr 10 18:34:46 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:47 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b" returned: 0 in 0.470s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:47 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b Apr 10 18:34:47 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:47 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-a5fd0a56-94df-4778-81dd-79d64437b84b" returned: 0 in 0.411s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-a5fd0a56-94df-4778-81dd-79d64437b84b" released by "delete_volume" :: held 0.907s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Created reservations ['477c0833-3853-4793-80e2-e4d9c5c0a06e', 'e83b2849-0afb-480c-be16-61a16d9a4e11', 'd4ff95c5-107d-45e5-ad38-bad7e76eb419', '4780c490-fccc-4285-b7e5-d19c01557c6f'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:47 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:47 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-66ad8b18-a6c6-4d24-959c-668f96aa3e51-delete_volume" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-66ad8b18-a6c6-4d24-959c-668f96aa3e51-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "cinder-quobyte-66ad8b18-a6c6-4d24-959c-668f96aa3e51" by "delete_volume" {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-66ad8b18-a6c6-4d24-959c-668f96aa3e51" acquired by "delete_volume" :: waited 0.014s {{(pid=82020) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee719d5-34ef-4ea5-b25c-79b117def5ce]: (4, 'qcow2') {{(pid=83028) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:47 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 Apr 10 18:34:47 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:47 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.427s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:47 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Deleted volume successfully. Apr 10 18:34:47 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-d1d54471-3ba7-48c9-922d-63821b002682 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-a5fd0a56-94df-4778-81dd-79d64437b84b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:48 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51" returned: 0 in 0.467s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:48 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51 Apr 10 18:34:48 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:48 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278/volume-66ad8b18-a6c6-4d24-959c-668f96aa3e51" returned: 0 in 0.403s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-quobyte-66ad8b18-a6c6-4d24-959c-668f96aa3e51" released by "delete_volume" :: held 0.891s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG cinder.quota [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Created reservations ['3dc67447-f777-4859-bf73-c3e17efe169d', 'b4898610-ac16-48a6-ae23-0356742d5fa0', 'fa5a90b5-0130-4c5e-8a5b-e752e103a642', 'b1648f40-e446-4e8e-a124-1f96f16e2a32'] {{(pid=82020) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514': None} {{(pid=82020) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG cinder.volume.drivers.quobyte [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-63154f16-aef6-4758-a5b4-87b3fa9d5514'] {{(pid=82020) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.lockutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82020) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 18:34:48 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 18:34:48 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278 Apr 10 18:34:48 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 18:34:49 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 10 18:34:49 devstack cinder-volume[82020]: DEBUG oslo_concurrency.processutils [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4a3781330c5ca416b983bd5bb6391278" returned: 0 in 0.479s {{(pid=82020) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 18:34:49 devstack cinder-volume[82020]: DEBUG cinder.manager [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Notifying Schedulers of capabilities ... {{(pid=82020) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 18:34:49 devstack cinder-volume[82020]: INFO cinder.volume.manager [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Deleted volume successfully. Apr 10 18:34:49 devstack cinder-volume[82020]: DEBUG cinder.coordination [None req-a4aee601-b3a4-417e-a10d-6d8211792c66 tempest-CinderUnicodeTest-421849959 None] Lock "cinder-66ad8b18-a6c6-4d24-959c-668f96aa3e51-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=82020) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 18:34:58 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:SELECT=148,cinder:INSERT=44,cinder:UPDATE=244,cinder:DELETE=16 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 18:34:59 devstack cinder-volume[82020]: DEBUG dbcounter [-] [82020] Writing DB stats cinder:UPDATE=205,cinder:SELECT=166,cinder:DELETE=20,cinder:INSERT=68 {{(pid=82020) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}